-- Logs begin at Tue 2022-08-30 15:37:48 UTC, end at Tue 2022-08-30 16:33:12 UTC. -- Aug 30 16:02:31.906421 dv-cinder-852208-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 16:02:31.915780 dv-cinder-852208-13-smb devstack@keystone.service[81599]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 16:02:31 2022] *** Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: nodename: dv-cinder-852208-13-smb Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: machine: x86_64 Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: clock source: unix Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: pcre jit disabled Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: detected number of CPU cores: 4 Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: current working directory: / Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: detected binary path: /usr/bin/uwsgi-core Aug 30 16:02:31.917809 dv-cinder-852208-13-smb devstack@keystone.service[81599]: your processes number limit is 47680 Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: your memory page size is 4096 bytes Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: detected max file descriptor number: 2048 Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: lock engine: pthread robust mutexes Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: thunder lock: enabled Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 16:02:31.918428 dv-cinder-852208-13-smb devstack@keystone.service[81599]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 16:02:31.956653 dv-cinder-852208-13-smb devstack@keystone.service[81599]: Python main interpreter initialized at 0x5602fa5069c0 Aug 30 16:02:31.956653 dv-cinder-852208-13-smb devstack@keystone.service[81599]: python threads support enabled Aug 30 16:02:31.956653 dv-cinder-852208-13-smb devstack@keystone.service[81599]: your server socket listen backlog is limited to 100 connections Aug 30 16:02:31.956653 dv-cinder-852208-13-smb devstack@keystone.service[81599]: your mercy for graceful operations on workers is 90 seconds Aug 30 16:02:31.958043 dv-cinder-852208-13-smb devstack@keystone.service[81599]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 16:02:31.958043 dv-cinder-852208-13-smb devstack@keystone.service[81599]: *** Operational MODE: preforking *** Aug 30 16:02:31.958043 dv-cinder-852208-13-smb devstack@keystone.service[81599]: *** uWSGI is running in multiple interpreter mode *** Aug 30 16:02:31.958043 dv-cinder-852208-13-smb devstack@keystone.service[81599]: spawned uWSGI master process (pid: 81599) Aug 30 16:02:31.958025 dv-cinder-852208-13-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 16:02:31.963004 dv-cinder-852208-13-smb devstack@keystone.service[81599]: spawned uWSGI worker 1 (pid: 81608, cores: 1) Aug 30 16:02:31.963004 dv-cinder-852208-13-smb devstack@keystone.service[81599]: spawned uWSGI worker 2 (pid: 81609, cores: 1) Aug 30 16:02:31.963004 dv-cinder-852208-13-smb devstack@keystone.service[81599]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 16:02:36.280437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:02:36.280437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: from cryptography.utils import int_from_bytes Aug 30 16:02:36.281224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:02:36.281224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: from cryptography.utils import int_from_bytes Aug 30 16:02:36.283023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:02:36.283023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: from cryptography.utils import int_from_bytes Aug 30 16:02:36.283482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:02:36.283482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: from cryptography.utils import int_from_bytes Aug 30 16:02:36.333613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:02:36.333801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:02:36.333986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] command line args: [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:02:36.334261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:02:36.334440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ================================================================================ {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:02:36.334693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:02:36.334782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] admin_token = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.334891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:02:36.334968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] config_dir = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.335111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] command line args: [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:02:36.335189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.335304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] config_source = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.335386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:02:36.335485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] debug = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.335566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ================================================================================ {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:02:36.335685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.335943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] admin_token = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] config_dir = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] config_source = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] debug = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.336923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_config_append = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_dir = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_file = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.337997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_config_append = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_dir = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_file = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.338935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.339900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.340867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] publish_errors = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.341922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] publish_errors = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.342876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] standard_threads = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] use_journal = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.343991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] standard_threads = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] use_json = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] use_stderr = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] use_syslog = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] use_journal = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.344869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.344941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] use_json = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.345071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.345154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] use_stderr = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.345281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] use_syslog = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.345364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.345513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:02:36.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.345770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.345847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.346995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.347886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.348558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.348778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.348991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.349985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.350952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.351963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.352968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.353913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.354861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.355959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.356951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.357906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.358994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.359992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.360940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.361860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.362822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.363959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.364921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.365985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.366895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.367904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.368988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.369979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.370924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.371966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.external = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.external = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.372978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.password = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.password = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] auth.token = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] auth.token = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.373998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.374947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.375948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.376990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.377917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.378914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.379976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.380977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.381949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.382892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.383871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.384953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.385985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.386970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.387931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.388864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.389979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.390904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.391949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.392879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.393975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.394060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.394202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.394280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.394433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.394518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.395215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.395329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.395572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.395829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.395956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.396961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.397975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.398929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.399896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.400980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.401931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.402879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.403952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.404889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.405927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] role.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] role.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.406910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] role.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] role.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.407940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.408972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.409996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.410120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.410254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.410930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.411667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.412925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.413957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.414855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.415893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.416910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.417901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.418915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.419952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.connection = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.420942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.421833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.connection = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.422969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.423897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.424938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:02:36.425444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:02:36.452319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.452528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.452760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.453504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.453736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.453959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.461659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.463430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.490287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.490514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.490786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.491044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.544897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.545600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.593666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.593897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.595887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.596120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.751481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.751717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.751947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.752812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.753026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.753238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.776423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.776653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.776739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.776871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.777928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.789767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.790512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.802870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.803956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.804985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.805196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 16:02:36.820920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.821128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 16:02:36.821469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.821668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 16:02:36.821941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.822203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.822286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.822461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.822544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 16:02:36.822717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.822809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.823018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 16:02:36.823294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.823559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.823821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.824079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.832351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.832630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.832901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.833181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.834258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.834543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.834817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.835121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.840249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.842043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.843135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.843421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.843707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.843993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.844276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.844537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.844806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.844956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.845081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.845888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.846082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.846343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.846611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.846881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.847179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.847470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.847717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.874705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.876040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.876471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.876761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.877635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.877924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.882681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.882971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.883281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.883508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.883884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.884222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.890320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.890611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.891354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.891649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.894721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.895585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.895881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.896164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.896249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.896480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.896565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.896801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.897092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.897375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.898545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.898841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.899177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.899518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.899817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.900118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.914869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.915175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.915742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.916027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.919028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.919934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.922146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.922506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.924750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.925121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.927660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.930902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.932370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.934022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.934338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.934628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.934956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.935268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.935683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.935861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.939124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.939518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.939821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.940112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.940398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.940797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.953581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.954038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.954465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.954886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.961734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.962249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.962697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.963078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.963441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.965686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.967308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.967600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.970541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.970827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.970915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.971147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.971443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.971741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.972610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.974347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.974627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.977476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.977763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.978052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.978340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.978626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.984160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.984454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.984740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.985026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.985312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.985608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.985890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.990923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:36.991238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.991527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.991815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.992104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.992387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:36.992692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.002218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.005869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.008784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.009388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.010217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.011732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.012022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.012319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.012473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.015374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.016825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.018308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.018605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.018833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.018918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.020369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.023263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.023558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.023850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.024144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.025463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.026956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.029857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.030164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.030459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.030743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.032104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.032409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.032694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.039025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.039308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.039595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.040152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.040455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.040739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.041019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.041293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.041580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.041867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.042148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.042429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.042714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.043006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.043272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.043549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.043810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.046675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 16:02:37.046963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.047272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.047553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.047830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.048114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.048393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.048675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.048964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.049245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.049520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.049784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.050052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.050327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 16:02:37.079260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602fa5069c0 pid: 81608 (default app) Aug 30 16:02:37.082921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee4cb-49aa-4270-a6fb-f16328dd2a0f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:37.083256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee4cb-49aa-4270-a6fb-f16328dd2a0f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:37.083534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee4cb-49aa-4270-a6fb-f16328dd2a0f None None] PATH_INFO: `/v3` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:37.085531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602fa5069c0 pid: 81609 (default app) Aug 30 16:02:37.087676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Aug 30 16:02:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:43.686459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:43.687102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:43.687102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:43.691451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:02:43.697428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:43.697990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:43.697990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:43.770011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: INFO dbcounter [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] Registered counter for database keystone Aug 30 16:02:43.789478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG oslo_db.sqlalchemy.engines [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:02:43.795626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writer thread running {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:02:43.972296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG passlib.handlers.bcrypt [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81608) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 16:02:43.972685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG passlib.handlers.bcrypt [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81608) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 16:02:44.031536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:44.033152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:44.160444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 16:02:44.642442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:44.713302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: INFO dbcounter [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] Registered counter for database keystone Aug 30 16:02:44.734904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG oslo_db.sqlalchemy.engines [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:02:44.742094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writer thread running {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:02:44.867373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfc8a0-0b44-4313-8905-c7711f730f57 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:44.871641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:44.872264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:44.872543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:44.872815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:44.881438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:44.933534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING keystone.common.rbac_enforcer.enforcer [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 16:02:44.933828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bacd33-4b41-436b-8e72-5874f4f2774f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:44.943637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Aug 30 16:02:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:02:44.949508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:44.963965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0914fc3-48d5-4fcd-b9ec-c1c0d1df07a6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:44.968360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:44.969451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:44.969731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:44.969999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] PATH_INFO: `/v3/projects/182090e6549d4fc0b6e88a4c20692c62` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:44.971605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=182090e6549d4fc0b6e88a4c20692c62)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:45.024327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 16:02:45.024676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bef6a8-4657-43c1-afb6-d93af441e8e9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:45.029211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Aug 30 16:02:44 2022] GET /identity/v3/projects/182090e6549d4fc0b6e88a4c20692c62 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:46.912387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd27-d1c8-439a-96e4-efc7dacafa52 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:46.912884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd27-d1c8-439a-96e4-efc7dacafa52 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:46.912987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd27-d1c8-439a-96e4-efc7dacafa52 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:46.917033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:02:46.922352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:46.922760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:46.922915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:46.942876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:46.944443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:46.952244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 16:02:47.219485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbd27-d1c8-439a-96e4-efc7dacafa52 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:47.232282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbd27-d1c8-439a-96e4-efc7dacafa52 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:47.237093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:47.237696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:47.237982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:47.238255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:47.246475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:47.248285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd12c94-b16b-4ab0-88fb-fc9c1d16afd1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:47.257204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Aug 30 16:02:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:02:47.262380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:47.271534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f2cd-ff99-4bb5-9154-51b171d2d1f9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:47.275897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:47.276515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:47.276798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:47.277072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:47.278380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:47.280252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034398-9a1f-44ae-b51f-4ec4de17b5d0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:47.281768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Aug 30 16:02:47 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:49.268417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ade-adf2-4fea-9fc0-3cfdace563a0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.268949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ade-adf2-4fea-9fc0-3cfdace563a0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.268949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ade-adf2-4fea-9fc0-3cfdace563a0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.270341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:49.275845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.276245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.276404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.287649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566782-a7d7-4618-aa90-ef6fbc599104 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.287936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566782-a7d7-4618-aa90-ef6fbc599104 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.288211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566782-a7d7-4618-aa90-ef6fbc599104 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.289499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:02:49.294377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.294665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.294939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.295394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:49.296612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:49.336344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG passlib.handlers.bcrypt [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81609) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 16:02:49.336743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG passlib.handlers.bcrypt [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81609) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 16:02:49.377859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:49.386792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:49.388397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:49.488116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:02:49.645174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:49.670568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:49.753787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18e9c-9071-4b68-9481-efecbd89e081 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:49.753992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:49.788912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:49.789547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.789833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.790113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.801441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:02:49.810924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:02:49.812051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:02:49.813045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:02:49.818517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:49.860496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82959-9545-409b-9fe5-6cc87c9712e0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:49.863843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:49.900651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:49.901440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.901728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.902005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.903657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:49.922805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4eee2-3e64-4113-8313-48b8c1977257 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:49.955801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:49.956411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:49.956696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:49.956974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:49.957645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:49.958486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:49.959926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:49.970421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:49.971470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:49.971971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:49.977660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.071700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:50.077074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462e1b-62ae-4c25-ab6d-f8e10c03d3dc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.077203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.079824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:50.111820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.112455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.112741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.113020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.114239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:50.116309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:50.117895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:02:49 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:50.123323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.139074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:50.177625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa59e9-831c-45c0-b51e-23d93df1fa64 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.210561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.211683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.211963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.212231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.222119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66475f-03db-43e3-b4b1-d88ed08ff602 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.230915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:50.232438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:02:50.250716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:02:50.251714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:02:50.252531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:02:50.252531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:02:50.252531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:02:50.252531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:02:50.257284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.257538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.257917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.258197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.258470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.259600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:50.261045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:50.262619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:50.268212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:50.315614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:50.347586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:50.361642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb896e9-f075-4999-9e46-cec4eb729866 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.367610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75e7f-889a-4cc2-a3f9-b643a22eb411 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:50.397203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.397816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.398100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.398374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.399039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:50.399347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:50.400739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f6fc2-4a0c-44db-9e5e-beb0ca842eb4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:50.405026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:50.405639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:50.405923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:50.406201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:50.406927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.domain.id=default, user.id=b0c8d533e615444eb88b70808ed8254b) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:50.407270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:50.408701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecbc1b-6e61-4299-ab4d-97fcc0047285 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:50.416021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Aug 30 16:02:50 2022] GET /identity/v3/role_assignments?user.id=b0c8d533e615444eb88b70808ed8254b&scope.domain.id=default&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:50.418489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:52.664802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be397-3dc9-49a1-a0e5-281f15569a3d None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.665663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be397-3dc9-49a1-a0e5-281f15569a3d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.666086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be397-3dc9-49a1-a0e5-281f15569a3d None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:52.667585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:52.673024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fa46-317d-4537-9200-cbc3d1eb8b7e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.673784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fa46-317d-4537-9200-cbc3d1eb8b7e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.674227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fa46-317d-4537-9200-cbc3d1eb8b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:52.697700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-99b2fa46-317d-4537-9200-cbc3d1eb8b7e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:52.699167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-99b2fa46-317d-4537-9200-cbc3d1eb8b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:52.732768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931fa4-e804-4d9b-9902-9ed5cd862703 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.733307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931fa4-e804-4d9b-9902-9ed5cd862703 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.733726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931fa4-e804-4d9b-9902-9ed5cd862703 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:52.735476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:02:52.741832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb2d4-8dc1-45e7-80f3-11461be6be7d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.742307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb2d4-8dc1-45e7-80f3-11461be6be7d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.742745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb2d4-8dc1-45e7-80f3-11461be6be7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:52.771716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-38beb2d4-8dc1-45e7-80f3-11461be6be7d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:52.773189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-38beb2d4-8dc1-45e7-80f3-11461be6be7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:52.824169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:52.889296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 16:02:52.991035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48362d7-630e-4770-8a75-65ca1264d402 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.991582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48362d7-630e-4770-8a75-65ca1264d402 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.992005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48362d7-630e-4770-8a75-65ca1264d402 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:52.993487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 12/26] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:52.998843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:52.999333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:52.999754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.022275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:53.023820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:53.117580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:53.329403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48362d7-630e-4770-8a75-65ca1264d402 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:53.396041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:53.452854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:53.456423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:53.489201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48362d7-630e-4770-8a75-65ca1264d402 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:53.548119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:53.548766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.549048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.549322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.561203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:53.562967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-42bf8d5d-d0f0-4bbb-82e9-be6611c3b3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:02:53.580308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:02:53.581367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:02:53.582372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:02:53.582372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:02:53.582372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:02:53.584638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 13/28] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:02:53.586177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24394e-7014-420a-b4c3-f4bc69f273ae None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.586628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24394e-7014-420a-b4c3-f4bc69f273ae None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.587096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24394e-7014-420a-b4c3-f4bc69f273ae None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.589594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 14/29] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:53.590481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24394e-7014-420a-b4c3-f4bc69f273ae None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:53.626386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d157e4-5bf3-46a4-ac84-2a212a4042d1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:53.666784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:53.667447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.667934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.668406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.679822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-db980e8b-677e-4202-b014-51da679d21ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:02:53.684944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:02:53.685765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:53.686526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:02:53.689232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 16/30] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:02:53.695460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.695985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.696946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.715170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:53.715571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24394e-7014-420a-b4c3-f4bc69f273ae None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:53.717279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:53.725911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:53.758497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:53.759257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.759612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.759958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.760697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:53.761075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:53.763108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:53.784233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 15/31] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:53.784233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:53.788598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:53.805423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:53.806699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:53.898157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5e61f-7fe8-4c84-98f0-0bbb05bf8b1f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:53.935192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:53.935836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:53.936152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:53.936543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:53.937381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:53.938905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b9a59-e9c9-4a82-beb6-eb6c2caad2f4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:53.963155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ca45-fdf2-4edd-9313-5ab25886a5e0 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:53.999563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.000552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.001093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.001570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.002447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:54.002947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.004672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.015017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 18/33] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:54.020459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.074690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 16/34] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Aug 30 16:02:53 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:54.076601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e37a-ba88-41ea-9708-2825ff175810 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.076601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e37a-ba88-41ea-9708-2825ff175810 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.076909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e37a-ba88-41ea-9708-2825ff175810 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.078447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 17/35] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:54.079050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e37a-ba88-41ea-9708-2825ff175810 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.081491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:54.104644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:54.137464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a600-33aa-45d7-91b3-0d41c6180149 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.177977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.179368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.179921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.180671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.181875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.183862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.209685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e37a-ba88-41ea-9708-2825ff175810 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.252395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.253278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.253660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.254080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.256274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.258201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2156-1465-41c6-8198-d909bead11d9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.260060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 18/36] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:02:54 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:54.265816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.266275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.266653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.290357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:54.290357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:54.341954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:02:54 2022] POST /identity/v3/projects => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:54.342936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.375837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 19/38] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:54.377804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.404226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:54.467797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca721f-bd78-4b3f-b672-2977d25e7723 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.479249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:54.503576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466c86-25c9-43c9-900e-e645ec1e9deb None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.511554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.512193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.512482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.512761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.513471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.514993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc46299-def1-43ca-9d09-c7d156e9ce8a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.537346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Aug 30 16:02:54 2022] POST /identity/v3/roles => generated 225 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:54.538856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ea72-309a-45a1-add4-f1c62a86f2c5 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.539550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ea72-309a-45a1-add4-f1c62a86f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.539852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ea72-309a-45a1-add4-f1c62a86f2c5 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.541659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 21/40] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:54.550228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.550432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.550527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.550527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.550677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.550677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.550677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.552126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.553622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.555383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 20/41] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:54.560992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.577591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:54.580181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:54.664973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:54.688070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c461d6-d992-4f6c-ae60-cb5deb838f3d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.732686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.734798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.735121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.735408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] PATH_INFO: `/v3/domains/default/users/b0c8d533e615444eb88b70808ed8254b/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.737649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b0c8d533e615444eb88b70808ed8254b, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.739209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.758648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Aug 30 16:02:54 2022] PUT /identity/v3/domains/default/users/b0c8d533e615444eb88b70808ed8254b/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:02:54.759294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:54.798688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 22/43] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:02:54.890436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e4a2-beb4-4f7f-aa31-9a5c15ac88a4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:54.927943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:54.928477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:54.928762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:54.929039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:54.929725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:54.931150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:54.946324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Aug 30 16:02:54 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:55.074192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:55.178211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:55.181984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2239d-583c-45fc-bd9a-ea8985772df9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:55.217046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:55.217680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:55.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:55.218250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:55.219402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:55.220857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e395a-0572-4c6c-9794-1c2690be0ef0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:55.222417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 23/45] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:55.228190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:55.232560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:55.328668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3a69-4a44-4f1f-8379-81435ee98a30 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:55.361924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:55.362534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:55.362822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:55.363137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:55.363798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:55.365823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e2e6-7dcb-4c60-b378-6e23ae50c568 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:55.393153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:02:55 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:02:56.695259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989262f-6a76-4187-b1e7-aa50168d832e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:56.695772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989262f-6a76-4187-b1e7-aa50168d832e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:56.695882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989262f-6a76-4187-b1e7-aa50168d832e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:56.697149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 24/47] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:56.702416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:56.702784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:56.702974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:56.721065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:56.722258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:56.771863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:56.789345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:57.063810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989262f-6a76-4187-b1e7-aa50168d832e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.167188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989262f-6a76-4187-b1e7-aa50168d832e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.201369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.201998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.202282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.202558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.213160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-857dd914-3470-4864-b1ed-8f31003e6749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:02:57.217965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:02:57.218933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:02:57.220075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 25/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:02:57.224920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.305334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f74b7-9231-4d60-867d-198dd752a726 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.305621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f74b7-9231-4d60-867d-198dd752a726 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.305905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f74b7-9231-4d60-867d-198dd752a726 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.307285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 26/50] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:02:57.312142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.312429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.312707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.323419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529a5f-9749-4035-957e-179b2bf717ef None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.330510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:57.331743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:57.352578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:57.358543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.359433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.359725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.360001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.360673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:57.360976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.362369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:57.373974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 25/51] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:57.379585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.404466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 27/52] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:02:57.428241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:57.476718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677626-cf38-4322-ae65-7a4ece19db4e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.509810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.510459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.510740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.511038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.512169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.513617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:57.515399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:57.521158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.620681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7389e9-9576-430d-ae96-1fcd95c4a08c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.653236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.653861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.654143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.654418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.655551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.657014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:57.658578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 28/54] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:02:57.664821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.679260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.704498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:57.787378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b075f3-87f3-4af0-aaa9-6d63c25af65c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.822706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.823373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.823658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.823937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.825065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.826535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:57.828147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 29/55] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:57.833611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:02:57.873865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5cd1-5fa0-463e-9c70-296396cfcac2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.889687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:57.908278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.908889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.909174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.909452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.910181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.domain.id=default, user.id=b0c8d533e615444eb88b70808ed8254b) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:02:57.910491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.912611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e235bcb-687f-4dc5-966b-a8b01ea59722 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:57.920754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 27/56] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Aug 30 16:02:57 2022] GET /identity/v3/role_assignments?user.id=b0c8d533e615444eb88b70808ed8254b&scope.domain.id=default&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 530 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:02:57.927217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:57.937082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e456a-8335-438c-bc64-28d5d96f569c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:02:57.972889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:02:57.973521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:57.973830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:57.974716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:57.975502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:02:57.976972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412fac5-6e60-425c-b58e-bf918a146fdb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:02:58.005339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 30/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Aug 30 16:02:57 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:02:59.891830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bbd5-0627-4efa-9ff0-009f816894f7 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:59.892316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bbd5-0627-4efa-9ff0-009f816894f7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:59.892403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bbd5-0627-4efa-9ff0-009f816894f7 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:59.893695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 28/58] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:02:59.899484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:02:59.899882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:02:59.900033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:02:59.918061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:02:59.919288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:02:59.984109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:00.260849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1bbd5-0627-4efa-9ff0-009f816894f7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:00.359758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1bbd5-0627-4efa-9ff0-009f816894f7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:00.392684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:00.393304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:00.393590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:00.393868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:00.395010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:00.396980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47fa8d-10d2-4a98-a14e-f86bd65d322c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:00.398515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 29/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:00.403889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:00.475048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:00.499975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff17ed-d8f3-484d-845a-273ec8220e8f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:00.532732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:00.533265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:00.533544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:00.533820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:00.534458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:00.535924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd7a3-5037-4be8-938b-1e5674f4ab2e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:00.562317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 32/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:00 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:03.479985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5c9b-a635-4e39-916d-1a6ee587d5ae None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.481015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5c9b-a635-4e39-916d-1a6ee587d5ae None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.481509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5c9b-a635-4e39-916d-1a6ee587d5ae None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.483093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 30/62] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:03.488960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c70a-b43d-4f95-ada9-0472898a77b0 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.489811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c70a-b43d-4f95-ada9-0472898a77b0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.490305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c70a-b43d-4f95-ada9-0472898a77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.509298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4c49c70a-b43d-4f95-ada9-0472898a77b0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:03.510817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4c49c70a-b43d-4f95-ada9-0472898a77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:03.605361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:03.893896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a446c-3e78-45e3-8c73-626ece585a32 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.894521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a446c-3e78-45e3-8c73-626ece585a32 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.895035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a446c-3e78-45e3-8c73-626ece585a32 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.897557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 31/64] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:03.909333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474254c5-9a7d-43ba-b7fd-a986f753527d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.909834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474254c5-9a7d-43ba-b7fd-a986f753527d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.910262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474254c5-9a7d-43ba-b7fd-a986f753527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.921663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05c45a-ae1a-49dc-a587-08f8444ea04c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.922239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05c45a-ae1a-49dc-a587-08f8444ea04c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.922783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05c45a-ae1a-49dc-a587-08f8444ea04c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.924462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 32/65] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:03.930479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:03.931096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:03.931572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:03.940054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-474254c5-9a7d-43ba-b7fd-a986f753527d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:03.941254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-474254c5-9a7d-43ba-b7fd-a986f753527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:03.951855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:03.953421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:04.003787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.018378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.028869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:04.029706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.033985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 34/67] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:04.042264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6bc3b-ae12-46f9-bf45-23282ec5b49e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.042820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6bc3b-ae12-46f9-bf45-23282ec5b49e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.043321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6bc3b-ae12-46f9-bf45-23282ec5b49e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.044822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 35/68] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:04.049768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475b70d-d312-4d9d-9c0f-661cdf9993bd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.050391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475b70d-d312-4d9d-9c0f-661cdf9993bd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.050864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475b70d-d312-4d9d-9c0f-661cdf9993bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.071124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b475b70d-d312-4d9d-9c0f-661cdf9993bd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:04.072723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b475b70d-d312-4d9d-9c0f-661cdf9993bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:04.197560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 36/69] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:04.217962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619ad9e-2d8e-4914-84c3-1ff660a832a1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.246719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c7f-950a-429c-b2a1-a93b51a34cc6 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.247069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c7f-950a-429c-b2a1-a93b51a34cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.247313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a0c7f-950a-429c-b2a1-a93b51a34cc6 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.248861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 37/70] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:04.254408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.254920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.255583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.263332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.264837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.265129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.265408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.281999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:04.285404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:04.288687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:04.295736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:04.296589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:04.297345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:04.304924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 34/71] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:04.310776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.379971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.398255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 38/72] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:04.399920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.458081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153470a-ceef-4d78-8a7e-27d1eb7b682a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.463646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.503477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.504148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.504442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.504727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.505443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:04.505752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:04.507224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:04.515740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 35/73] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:04.516683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.522284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958aa7-b502-4ec3-b0a1-35b60ac79d09 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.563400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.564780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.565557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.566156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.577192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:04.582037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:04.582883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:04.583717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 39/74] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:04.584343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.625959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.628863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fa94d-fca6-484e-80ba-ceb57e266041 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.665443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.666078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.666361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.666636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.677004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:04.682833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:04.683707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 36/75] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:04.687862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.701164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ded68-1334-4c83-8b7e-91019072a836 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.712387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.736803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.737435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.737720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.738001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.748403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:04.753198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:04.754222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:04.755008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:04.755677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.785909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d7621-fce0-41d2-862a-f14cb0be3c95 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.819468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.820103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.820392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.820671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.836063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:04.837556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:04.839695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 37/77] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:04.840018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.861343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.862424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c21d-769b-4a54-8a1e-02a4e47e6232 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.897582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.898193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.898484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.898761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.899466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:04.899776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:04.901196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:04.909130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 41/78] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:04.909913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:04.941283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:04.946618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f94fb-5bfa-453b-8485-7eecdb97057e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:04.983297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:04.983861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:04.984147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:04.984426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:04.985810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:04.987305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:04.988883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 38/79] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:04.989651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.015539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f971-d9f8-4190-ac93-a4eabc92043e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.049581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.050197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.050482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.050763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.051473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:05.051784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.053340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.061109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 42/80] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.061901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.077012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.092560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69bc2-5a56-46f9-8550-83358449cc52 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.126211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.126823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.127142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.127424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.128097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:05.128406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.129802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.138154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 39/81] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.143003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.154999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.162655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ce9a-00ee-4d2c-bafa-85c7555cd4c7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.196656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.197261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.197542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.197822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.238769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac0b1b-4fc3-453a-8e00-ff2ee2fba024 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.266817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.268334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.272216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.272868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.273155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.273434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.274574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.276042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.277616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 40/82] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.278360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.296862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.367702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.375407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:05.376519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.379992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32170382-4b1a-4639-ac41-fa9430eed7e2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.414882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.415529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.415819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.416102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.416756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.418200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.444556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 41/84] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:05 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:05.444556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.479129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c2d7-24b2-4eaf-bcf9-9f3719e57a72 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.521984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.522652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.523254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.523254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.524501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.526008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.527892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 44/85] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.528477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.543432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.580846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a812e-3ee1-45d4-bcb6-2353fa8ead9d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.602136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.623505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.624483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.624483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.624700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.627382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.627382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.628973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 42/86] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.629823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.650061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749cc39-cf07-4856-8776-1bac778eeab2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.691991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.692898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.693332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.693923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.756059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaffc-4e28-48f5-8ed1-46acba51d985 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.773178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.774617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.799370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.800015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.800300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.800580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:05.801768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:05.803318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:05.805170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 43/87] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:05.805764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.817288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.859495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:05.906751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 45/88] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:05.907670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:05.926847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09143a7-8da0-4fe8-a7c1-2a7dbbf0547d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:05.964975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:05.965891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:05.966370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:05.966789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.018406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127d70d-2394-4180-815c-7e8c55850638 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.053694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.055898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.065321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.065955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.066242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.066524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.069593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.133188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.155574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.157318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.179284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 44/89] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:06.180072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.275994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 46/90] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:06.275994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.301713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca9d6-e008-45da-ab97-9a7d239a0209 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.312248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.345723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.346770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.347409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.347831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.349315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:06.350365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.352567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.353011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.359502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 45/91] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:06.361640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.438700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e38b2-6234-410a-a50c-db9ef0aa8369 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.485110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090409-c950-440d-b862-090605e2ac18 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.519720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.520448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.520834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.521753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.524956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.526141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.526651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.527181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.527633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.528076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.528822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 47/92] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:06.532138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.533573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.535613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.538330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 46/93] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:06.543044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.592350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.650393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f583eb-31df-4bdf-8059-5c5d811d77b8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.684954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.685910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.686415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.686885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.687896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=b0c8d533e615444eb88b70808ed8254b) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:06.688452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.690111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.696972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 47/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/role_assignments?user.id=b0c8d533e615444eb88b70808ed8254b&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:06.698035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.741635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bff6-168f-4b27-8368-4d981aa644ed None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.805026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:06.820856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:06.821514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:06.821798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:06.822080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] PATH_INFO: `/v3/projects/43ee12388a1645a393c665fd1d57ab9b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:06.825052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] RBAC: Authorizing `identity:get_project(project_id=43ee12388a1645a393c665fd1d57ab9b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:06.826578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:06.828505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 48/95] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/projects/43ee12388a1645a393c665fd1d57ab9b => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:06.835356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:06.980950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46598058-02de-4ef2-8a6f-46ca06d2bebf None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:06.987302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:07.003149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be04a-b109-4024-95c4-6cede854ac54 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:07.042958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:07.043749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:07.044044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:07.044335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:07.045214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=43ee12388a1645a393c665fd1d57ab9b, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:07.045531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:07.047307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f612-f53e-4a0d-8bab-d5a2dd34a0da None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:07.054227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 49/96] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=43ee12388a1645a393c665fd1d57ab9b&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:07.095859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:07.096871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:07.097372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:07.097851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:07.098810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:07.099613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:07.101556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de2d5-feb8-492d-9291-51c3c9bf84b9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:07.108782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 48/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:06 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=d34b130893c44c4697b28b2f332822a6 => generated 259 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:07.891864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba02a-db05-49ac-92a0-b06a09336904 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:07.892840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba02a-db05-49ac-92a0-b06a09336904 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:07.893319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba02a-db05-49ac-92a0-b06a09336904 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:07.894883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 50/98] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:07.900380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159996-8bcd-4eed-b42c-cd0e7ce6ae85 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:07.900785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159996-8bcd-4eed-b42c-cd0e7ce6ae85 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:07.900972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159996-8bcd-4eed-b42c-cd0e7ce6ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:07.928742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-aa159996-8bcd-4eed-b42c-cd0e7ce6ae85 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:07.929967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-aa159996-8bcd-4eed-b42c-cd0e7ce6ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:08.009031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 49/99] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:08.014539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709984-66e1-46ce-beea-570d491ea24f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:08.014829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709984-66e1-46ce-beea-570d491ea24f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:08.015132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709984-66e1-46ce-beea-570d491ea24f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:08.016675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 51/100] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:08.022190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:08.022491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:08.022772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:08.051532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:08.053316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:08.145415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 50/101] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:08.527128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709984-66e1-46ce-beea-570d491ea24f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:08.572840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:08.615892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:08.631542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:08.686371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709984-66e1-46ce-beea-570d491ea24f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:08.764747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:08.765707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:08.766001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:08.766282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:08.785632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d6a7c-d88a-4a97-b103-4a166774012b None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:08.793308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:08.799276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:08.800206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:08.800958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 52/102] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:08.806531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:08.871632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:08.872281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:08.872565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:08.872846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:08.873981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:08.875469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:08.877129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 51/103] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:08.883689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:08.994004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00498c-0a52-430e-9080-cca11ba584e6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:09.021797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:09.038865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:09.040765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:09.041397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.041692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.042124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.042814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:09.043155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:09.044579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:09.056510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845871-8f71-427e-9b05-fff18c266a3f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:09.062159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 53/104] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:09.068598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:09.130270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:09.131578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.132051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.133172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.134721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:09.137370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:09.199282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 52/105] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:03:08 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:03:09.274243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c929-eaf4-4d7b-ab71-1dc71eb2fa28 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:09.319696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:09.320261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.320548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.320825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] PATH_INFO: `/v3/users/4568f8936d9041ba808d268bbfc650f1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.341416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] RBAC: Authorizing `identity:get_user(user_id=4568f8936d9041ba808d268bbfc650f1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:09.342998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac7490-ca4d-4d14-b020-db21be96bd35 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:09.344760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 54/106] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:09 2022] GET /identity/v3/users/4568f8936d9041ba808d268bbfc650f1 => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:09.350644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:09.444225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef42c7-71fb-4e79-aace-2ea4cee66e38 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.444540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef42c7-71fb-4e79-aace-2ea4cee66e38 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.444788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef42c7-71fb-4e79-aace-2ea4cee66e38 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.446133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 55/107] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:09.456730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db052f-7c21-41c3-aa94-fb2e34f5b719 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.457010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db052f-7c21-41c3-aa94-fb2e34f5b719 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.457292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db052f-7c21-41c3-aa94-fb2e34f5b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.487187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-31db052f-7c21-41c3-aa94-fb2e34f5b719 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:09.488424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-31db052f-7c21-41c3-aa94-fb2e34f5b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:09.511972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2fae1-01b7-4a03-9b09-a907cade174f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:09.563240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:09.575250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:09.576176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.576662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.577149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.601798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:09.606318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 56/108] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:09.608129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe88d3-af9f-4f5b-ad96-7aea52c9ed1c None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.608943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe88d3-af9f-4f5b-ad96-7aea52c9ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.609614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe88d3-af9f-4f5b-ad96-7aea52c9ed1c None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.611883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 57/109] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:09.618865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:09.619455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:09.620070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:09.644080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:09.646072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:09.672204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:09.673912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:09.775650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:09.825128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 53/111] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:09.831029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:09.920287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:09.973781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88921e-35dd-4a2a-b09c-4550449d7f09 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:09.979431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:09.996987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.037449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.038786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.039317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.039784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.041127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:10.042786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe9158-25a9-413e-af98-c35e258a5912 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:10.044652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 59/112] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:09 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:10.045987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c9e5-d136-415d-a82d-92b754cab53c None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.050069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c9e5-d136-415d-a82d-92b754cab53c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.050607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c9e5-d136-415d-a82d-92b754cab53c None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.052134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 60/113] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:10.053588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581c9e5-d136-415d-a82d-92b754cab53c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.085961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322365ce-7f92-4cc0-8bfe-27f591fd6772 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.132098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.133521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.133811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.134094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.147155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-537652a0-b221-444e-b96d-ca0d97e29e3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:10.153252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:10.154085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:10.154866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 54/114] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:10.156074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9982-bce3-45c5-a079-d9b4598274df None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.156368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9982-bce3-45c5-a079-d9b4598274df None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.156653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9982-bce3-45c5-a079-d9b4598274df None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.158213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 55/115] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:10.162682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720116-12a1-4e34-b72a-1e85b66b22f8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.162682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720116-12a1-4e34-b72a-1e85b66b22f8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.162682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720116-12a1-4e34-b72a-1e85b66b22f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.182216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581c9e5-d136-415d-a82d-92b754cab53c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.183843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-93720116-12a1-4e34-b72a-1e85b66b22f8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:10.185231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-93720116-12a1-4e34-b72a-1e85b66b22f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:10.220719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.221324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.221608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.221883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.222608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=4568f8936d9041ba808d268bbfc650f1) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:10.222918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:10.225019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:10.230746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 61/116] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/role_assignments?user.id=4568f8936d9041ba808d268bbfc650f1&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e82ae19017b845a9a74604cba0f09157 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:10.231580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.267760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 56/117] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:10.270353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.270887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.272242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.272622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.300740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:10.303814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:10.349928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.366017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9550-be2a-48f0-bf2b-cca2cc7a8a07 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.423694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:10.424564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.425325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.425946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.426219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.426498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.427199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:10.427676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:10.429100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:10.446439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 62/119] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:10.452516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.594588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.607191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95835-0e6d-4ac4-b659-0d4f2ca29893 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.650859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b768-a2c8-4622-af42-273ac950ba5c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.661749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.662786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.663300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.663826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.665220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:10.667003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:10.669178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 63/120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:10.670210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.724466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.727757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.728301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.728810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.747344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:10.753766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:10.754605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:10.755378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:10.763112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:10.765485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.810769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.822853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75346-d015-45ea-9af8-284040be9166 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.874321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.875319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.875803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.876699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.890599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:10.899464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:10.900385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:10.901147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:10.904265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 64/122] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:10.905258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:10.905983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8495874-967c-4e63-b199-ac3d9480065c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:10.938895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:10.953588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:10.954576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:10.955109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:10.955603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:10.957007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:10.960026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:10.962414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 59/123] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:10.963597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.019372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c486e-7264-4c89-8560-5e3b45a59906 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.059160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.059832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.060114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.060320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.060978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:11.061292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.062706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.071809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 65/124] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.072627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.074695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.082957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028142c5-3367-4714-a3a0-294cf6256814 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.122058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.123563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.124260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.124866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.136580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:11.141866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:11.142725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:11.143532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:11.145885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 60/125] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:11.146899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.169352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.185406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e3d1-943f-438e-84a6-f35eb2b59f76 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.220672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.221280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.221563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.221841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.222499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:11.222805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.224225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.237939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 66/126] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.237939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.272698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80681-a11a-4411-898f-384e4fb5b177 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.312521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.314045 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.314765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.315331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.317651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, user_id=2ae94bd7829d48f986b6dcc7bf1299ef, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.319888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.335902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 61/127] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:11 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:11.337271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.342753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20f8a8-0737-4c9c-ac85-1cd46238c1d4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.361044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.384404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.384955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.385262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.385514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.386710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.388214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.389788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.390547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.409869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.467372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcc045-3166-4e2f-8f0d-92585a4ef76f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.508068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.509047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.509560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.510035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.511031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:11.511623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.513245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.523532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 62/129] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.524893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.526292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf6b6-5996-4400-8b23-e7a1ea03e481 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.588912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.589566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.589976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.590167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.591336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.593175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.594909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 68/130] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.599221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.629240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.661866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128461f-ef16-46f8-a6c2-f42eda4ecce1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.705142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.711733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.712848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.713329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.714031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.716347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.718902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.721667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 63/131] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.722687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.725055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7217-4ed1-48c8-8d27-ba2488c02c2b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.773046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.773903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.774253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.774639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.776240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.777427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.779170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 69/132] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.779978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.847765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06bbb9-9835-44c1-9a9c-0b24d9dc3d26 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.886536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.887493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.888005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.888583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] PATH_INFO: `/v3/projects/43ee12388a1645a393c665fd1d57ab9b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:11.889895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] RBAC: Authorizing `identity:get_project(project_id=43ee12388a1645a393c665fd1d57ab9b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:11.891766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:11.893966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 64/133] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/projects/43ee12388a1645a393c665fd1d57ab9b => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:11.894897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:11.918090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:11.950782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858939-3c67-417a-b529-5422d98874e2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:11.996263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:11.996948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:11.997227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:11.997513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/users/b0c8d533e615444eb88b70808ed8254b/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.001955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, user_id=b0c8d533e615444eb88b70808ed8254b, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.003486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.014922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662360b9-be60-4b25-93c2-2410265b821e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.023344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 70/134] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:11 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/users/b0c8d533e615444eb88b70808ed8254b/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:12.027361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:12.044612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:12.063263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.063998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.064308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.064568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.065782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.067374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec69f-21d5-4120-b9a4-cae5f85db170 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.070026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 65/135] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:11 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:12.071086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e638-b5f7-4f2d-a655-9b5f8bb1f777 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.071477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e638-b5f7-4f2d-a655-9b5f8bb1f777 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.071764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e638-b5f7-4f2d-a655-9b5f8bb1f777 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.075102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 66/136] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:12.075815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e638-b5f7-4f2d-a655-9b5f8bb1f777 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:12.151403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895415e-69c7-46c3-9c6e-3a675433600a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.187032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:12.216824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.217676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.217970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.218369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] PATH_INFO: `/v3/projects/43ee12388a1645a393c665fd1d57ab9b/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.220836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] RBAC: Authorizing `identity:create_grant(project_id=43ee12388a1645a393c665fd1d57ab9b, user_id=2ae94bd7829d48f986b6dcc7bf1299ef, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.222939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddebff-e142-42cf-9f4a-c44ca0a65c65 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.239556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 71/137] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:12 2022] PUT /identity/v3/projects/43ee12388a1645a393c665fd1d57ab9b/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:12.241670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.241967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.242248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.242938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e638-b5f7-4f2d-a655-9b5f8bb1f777 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.272793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:12.274092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:12.351773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.352648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.353036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.353422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.359941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, user_id=2ae94bd7829d48f986b6dcc7bf1299ef, role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.361862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb55b7c-67bf-4a71-b228-2d55b0504154 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.364910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 72/138] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:12.378701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:12 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/users/2ae94bd7829d48f986b6dcc7bf1299ef/roles/d34b130893c44c4697b28b2f332822a6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:12.745479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:12.746953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3420-161d-45c6-aeff-0699d5347b3a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.747282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3420-161d-45c6-aeff-0699d5347b3a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.747567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3420-161d-45c6-aeff-0699d5347b3a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.747662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:12.749299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 68/140] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:12.754383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.754672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.754954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.788409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:12.790469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:12.911646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 69/141] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:12.931583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a07b-52cf-4e5e-8f5d-1a66aabbfed2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:12.968900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:12.969895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:12.970426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:12.970900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:12.972269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:12.973945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:12.979106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 73/142] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:12.982298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:13.070165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:13.111674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522faabf-78f9-410c-9bb4-c995f2c8ee88 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:13.154780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:13.155420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:13.155703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:13.155977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:13.156634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:13.158075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:13.185805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 70/143] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:12 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:13.284697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:13.378812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:13.419986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac806f-dc9a-4d0f-9ecd-553b4f675c63 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:13.465986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:13.467084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:13.467570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:13.468044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:13.485105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:13.491401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:13.492320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:13.493079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:13.495571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 74/144] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:13.501428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:13.611198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6853b4-480c-40ee-99d4-f0fc0eeed94e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:13.640654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:13.654906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:13.656122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:13.656808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:13.657350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:13.658431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:13.658738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:13.660146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:13.669578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 71/145] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:13.675010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:13.810662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68f0c8-9959-4f32-93ad-7a0be3186e24 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:13.851903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:13.851903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:13.851903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:13.851903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] PATH_INFO: `/v3/users/4568f8936d9041ba808d268bbfc650f1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:13.852341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] RBAC: Authorizing `identity:get_user(user_id=4568f8936d9041ba808d268bbfc650f1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:13.853657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:13.855310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 75/146] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:13 2022] GET /identity/v3/users/4568f8936d9041ba808d268bbfc650f1 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:13.856078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:13.862618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:14.005705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc142c67-661c-4c93-b95e-27a33c3c9d42 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:14.049224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:14.049860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.050138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.050413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.051573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:14.053175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafea9b-7c11-4d1c-ace5-34e2c42b87b4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:14.054823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 72/147] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:13 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:14.060577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:14.214731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6529c-c920-4d65-8b30-4968ce651fec None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:14.259443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:14.260457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.260939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.261424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/users/4568f8936d9041ba808d268bbfc650f1/roles/e82ae19017b845a9a74604cba0f09157` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.263616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, user_id=4568f8936d9041ba808d268bbfc650f1, role_id=e82ae19017b845a9a74604cba0f09157)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:14.265319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880dc0-fda5-4d9c-a3cf-473497e52460 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:14.285145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 76/148] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:14 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/users/4568f8936d9041ba808d268bbfc650f1/roles/e82ae19017b845a9a74604cba0f09157 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:14.296615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de93cd-9097-49f7-afcb-0c883ffe3cfa None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.296911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de93cd-9097-49f7-afcb-0c883ffe3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.297172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de93cd-9097-49f7-afcb-0c883ffe3cfa None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.298512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 73/149] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:14.304958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab8e2-14f5-401b-a676-a4439ac16e0c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.305586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab8e2-14f5-401b-a676-a4439ac16e0c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.306075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab8e2-14f5-401b-a676-a4439ac16e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.330657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-986ab8e2-14f5-401b-a676-a4439ac16e0c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:14.332455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-986ab8e2-14f5-401b-a676-a4439ac16e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:14.402711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:14.419769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 77/150] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:14.727874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de93cd-9097-49f7-afcb-0c883ffe3cfa None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:14.800126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:14.863065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de93cd-9097-49f7-afcb-0c883ffe3cfa None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:14.910156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:14.911191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.911692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.911804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d55d-5cb1-4703-9aaa-e02a4ce88d18 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.912071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d55d-5cb1-4703-9aaa-e02a4ce88d18 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.912353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d55d-5cb1-4703-9aaa-e02a4ce88d18 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.912750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.915249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 78/151] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:14.920154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:14.920486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:14.920711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:14.932663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:14.944107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:14.945034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:14.945862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 74/152] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:14.955568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:14.956869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:14.958494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:15.087570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 79/153] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:15.147895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc71a9-1d72-4849-abba-6c5b81a1ebe4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:15.166655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:15.190704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:15.191506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.191795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.192072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.192885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:15.193916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:15.195557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:15.205159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 75/154] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:15.210973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:15.352672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81b507-3370-4377-b9ef-543d7baf4584 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:15.373581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:15.392769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:15.393468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.393752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.394024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.395196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:15.397191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f6842-0eb1-46cc-a1bd-bd2aac1541d2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:15.398769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 80/155] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:15 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:15.404638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:15.482834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0165d9-e7e7-404b-b30c-09e432fda6b7 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.483216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0165d9-e7e7-404b-b30c-09e432fda6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.483488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0165d9-e7e7-404b-b30c-09e432fda6b7 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.484814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 81/156] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:15.491303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb078b7-2714-4cba-a7a7-24e22ae9a5b0 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.491583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb078b7-2714-4cba-a7a7-24e22ae9a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.491856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb078b7-2714-4cba-a7a7-24e22ae9a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.533538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4fb078b7-2714-4cba-a7a7-24e22ae9a5b0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:15.534727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4fb078b7-2714-4cba-a7a7-24e22ae9a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:15.560270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b4f55-d9b8-406f-8c2a-ea7890b44205 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:15.606209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:15.606749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.607061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.607342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.680291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:15.682465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 82/157] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:15.683839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ff01-df0c-49cc-9944-db2f488c09f8 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.685939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ff01-df0c-49cc-9944-db2f488c09f8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.686222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ff01-df0c-49cc-9944-db2f488c09f8 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.687514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 83/158] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:15.693705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:15.693978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:15.694351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:15.702121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:15.707741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:15.727247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:15.728472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:15.840785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 76/159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:15.841650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:15.844707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 84/160] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:15.850829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:15.952494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:15.972529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:16.002712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b72e-9629-4f59-9b29-a6cd6c2f16b5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.061207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.061904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.062191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.062463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.076499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:16.078923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752986-38de-47d4-a247-6399d0cc0232 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:16.081416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:16.082284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:16.083124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 77/161] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:16.088286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.154742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.154742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.154742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.154742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.155401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:16.156787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:16.163253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 85/162] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:15 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:16.169982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.253294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5cc2d-98b7-4db6-843e-47afc34213a6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.315069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60b1e-4762-4cad-b6bf-5d9c611392c5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.316050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.316975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.317537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.318015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.319168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:16.319669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:16.321253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:16.329969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:16.335423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 78/163] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:16.337871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.344355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:16.385220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.386525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.387027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.387555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.388486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:16.389003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:16.390645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:16.404875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 86/164] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:16.407024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.634384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1ea4-3024-4d2f-bd67-19c0b206d316 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.669034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e028-f70a-4fc2-a02b-8698f1974233 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.718998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.719651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.719936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.720229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.725083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:16.726097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:16.726596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:16.727092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:16.730643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:16.732536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:16.734368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 87/165] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:16.741417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.741587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:16.753608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:16.754504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:16.755576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 79/166] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:16.756812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:16.823268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:16.884778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:16.918660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849720a-b73b-44be-99df-b5aa66b36bb1 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:16.955146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e18c4-d26c-4065-9ade-14b12837e98a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.028377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.029039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.029327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.029611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.048308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.048943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.049227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.049500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.055472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:17.060864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:17.061821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:17.062694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 88/167] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:17.063379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.191610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.193770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.313551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983eff3-460c-48b3-a046-aa69acc5279c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.314069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:17.324995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:17.382714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.383623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.384066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.384497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.385328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:17.387242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.392238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 80/168] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:17.392455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.394830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.416025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 89/169] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.416742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.508441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522afac-aea2-48df-bcd5-84c3bd3a1700 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.544635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.545602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.546086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.546701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.547642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:17.548148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.549723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.559056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 81/170] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.560179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.567147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139ca12-218c-44e2-8631-bb8cfff664a4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.592132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:17.629031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.629672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.629951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.630219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.633060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.634415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.636523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 90/171] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.637407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.675744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757649-ac9f-4803-8708-89b5c1cac5cf None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.720196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.721190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.721677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.722156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] PATH_INFO: `/v3/users/b0c8d533e615444eb88b70808ed8254b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.723375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:17.727753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8d533e615444eb88b70808ed8254b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.729506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166b7f9-e9cc-4b09-ab1c-8fb86623169f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.731603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 82/172] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/users/b0c8d533e615444eb88b70808ed8254b => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.732809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ff2a-9ba5-4811-902c-12d0e1c9fd91 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.733099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ff2a-9ba5-4811-902c-12d0e1c9fd91 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.733380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ff2a-9ba5-4811-902c-12d0e1c9fd91 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.734581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 83/173] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:17.735304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ff2a-9ba5-4811-902c-12d0e1c9fd91 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:17.837613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:17.847799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ff2a-9ba5-4811-902c-12d0e1c9fd91 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.853293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1ed8b-5e4c-47b9-90b6-67720cfe7ac7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:17.885001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.885653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.885937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.886256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.887021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:17.887354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.888935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0640b5c-3bde-4094-815b-3ae8ac8ef7b5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.895224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 84/174] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=d34b130893c44c4697b28b2f332822a6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.897149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.897509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.897930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.917281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:17.918560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:17.932989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:17.934007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:17.934502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:17.935011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] PATH_INFO: `/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:17.939829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae94bd7829d48f986b6dcc7bf1299ef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:17.941643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:17.944235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 91/175] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/users/2ae94bd7829d48f986b6dcc7bf1299ef => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:17.945277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.000173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 85/176] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:18.000870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.094432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.111078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4363a-0e5b-4e5f-a268-2009a6b5850d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.152214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.152552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.152713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.152985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.183647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7122a-865f-472c-8f09-c41d2d568036 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.186694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.225933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.227678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73326c5-ded5-49d2-8e47-78e4615f6779 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.229257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.231381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.231892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.232516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.356430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.357827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.372920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.398851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 86/177] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:18.400282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c544-a85f-461e-bf83-f399d7756cd4 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.400575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c544-a85f-461e-bf83-f399d7756cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.400851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c544-a85f-461e-bf83-f399d7756cd4 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.402401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 87/178] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:18.403137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75c544-a85f-461e-bf83-f399d7756cd4 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.498696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 92/179] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:18.499708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.504239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.533773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75c544-a85f-461e-bf83-f399d7756cd4 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.570366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.571092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.571384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.571660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.582881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-7d50073a-21b3-4901-b49e-c13a13922819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:18.588649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:18.589539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:18.590325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 88/180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:18.592212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.592497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.592770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.612439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:18.613718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:18.616570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9b4e-7a40-4cf6-931e-fb2d90d6f61e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.651889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.652523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.652806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.653078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] PATH_INFO: `/v3/projects/43ee12388a1645a393c665fd1d57ab9b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.654207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] RBAC: Authorizing `identity:get_project(project_id=43ee12388a1645a393c665fd1d57ab9b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.655733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8946951-ccd8-4cbd-8a3d-51fdc43ba138 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.657362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 93/181] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/projects/43ee12388a1645a393c665fd1d57ab9b => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:18.658480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-e2d0-4162-bd61-ca16fa683646 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.658760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-e2d0-4162-bd61-ca16fa683646 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.659053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-e2d0-4162-bd61-ca16fa683646 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.660250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 94/182] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:18.665169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39f9f-e2d0-4162-bd61-ca16fa683646 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.665305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.696084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 89/183] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:18.696760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.747784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.781639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39f9f-e2d0-4162-bd61-ca16fa683646 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.816727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.817357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.817638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.817912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.819585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.821068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.821794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77369ecd-1461-4da2-a4a0-2208ea780532 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.823008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 95/184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:18.823471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.867219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.868186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.868715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.869166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.870032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:18.870553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.872251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa19f-d74f-44ec-96a3-25277402c287 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.883087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 90/185] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:18.884362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2013-9709-4bfc-ac20-1acaf9a790b4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.884646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2013-9709-4bfc-ac20-1acaf9a790b4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.884916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2013-9709-4bfc-ac20-1acaf9a790b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.902903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-52ef2013-9709-4bfc-ac20-1acaf9a790b4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:18.904113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-52ef2013-9709-4bfc-ac20-1acaf9a790b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:18.934714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:18.937957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b35ae5-1630-47cb-a4ed-060726a1808d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:18.974548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:18.975200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.975471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.975743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.976471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=43ee12388a1645a393c665fd1d57ab9b, user.id=2ae94bd7829d48f986b6dcc7bf1299ef) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:18.976779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:18.978213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:18.978656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 91/186] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:18.979931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d564-3615-4280-984a-2d6b82d78a20 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:18.980223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d564-3615-4280-984a-2d6b82d78a20 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:18.980497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d564-3615-4280-984a-2d6b82d78a20 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:18.981725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 92/187] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:18.982425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d564-3615-4280-984a-2d6b82d78a20 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.989103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 96/188] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/role_assignments?user.id=2ae94bd7829d48f986b6dcc7bf1299ef&scope.project.id=43ee12388a1645a393c665fd1d57ab9b&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:18.990714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:18.999727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.125450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d564-3615-4280-984a-2d6b82d78a20 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.138156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d809a-411f-48b1-9a2c-ba3e177c2a4c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.167432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.168136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.168486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.168866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.169688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=b0c8d533e615444eb88b70808ed8254b) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:19.170037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.171535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.179166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 93/189] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/role_assignments?user.id=b0c8d533e615444eb88b70808ed8254b&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.179938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.181273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.181915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.182191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.182462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.207454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.210360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab92798-8cd0-46c8-a13a-6c9486c71fc3 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.218156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 97/190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:18 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.218156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.218156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.218156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.232474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.242757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:19.244031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:19.315381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.325360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a657-d2fe-4089-a0d2-6de8542eb4b1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.329770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 98/191] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:19.330521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.376294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.377286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.377761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.378227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.395228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:19.401513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:19.402398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:19.403207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:19.404925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 94/192] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:19.409824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.454841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da91a5-9589-4eb2-b91b-d3c33f9f6e46 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.494869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.495559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.495838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.496108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.521134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.533162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66e419-86fc-401d-a51f-71dc7db79b1f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.556250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.569307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.570791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.572812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.573463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.573741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.574014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.584831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:19.590092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:19.590973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:19.591930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 95/193] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:19.592749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.679329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 99/194] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:19.680115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.698302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652282-7dc9-44dc-962b-222004fb948e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.731924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.732555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.732834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.733103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.733791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:19.734094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.735509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.744318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 96/195] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.745180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.760958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.775601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.784579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68b9d9-e0de-423f-9590-30c3cba12fa7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.819305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.819907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.820186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.820457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.821124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:19.821424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.822810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.830666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 100/196] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.835903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.848008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5ffa0-966b-4fc2-abcf-a0327cac8a44 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.884795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.885498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.885781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.886056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.887201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.888647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.890211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 97/197] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.890971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.940562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716b61-b95a-46fb-813a-f094cd4aaeff None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:19.972155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:19.977286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:19.977969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:19.978249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:19.978543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:19.980113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:19.981709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:19.983515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 101/198] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:19.984186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:19.996248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001be11-879d-4187-9915-0b09df9ac8c7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.010873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.030580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.031250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.031537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.031814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] PATH_INFO: `/v3/users/4568f8936d9041ba808d268bbfc650f1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.033012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] RBAC: Authorizing `identity:get_user(user_id=4568f8936d9041ba808d268bbfc650f1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.034483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.036279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 98/199] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/users/4568f8936d9041ba808d268bbfc650f1 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:20.036839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.090587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496e3d7-a206-47d9-afca-a94bf5cf88e3 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.124325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.124954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.125245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.125523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.126670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.128166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.129735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 102/200] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:19 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:20.130489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.139888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2811646-151f-41c0-8238-02d582c38a03 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.173136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.173746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.174028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.174303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.174957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.176422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.198491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 99/201] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:20 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:20.199265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.208287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.244072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.258334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f772-e19a-48ca-9845-ff5e647d40d0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.297261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.297886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.298170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.298446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.299220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=280c6c3592b6458fac036c97b13ffa02) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:20.299533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.301020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.319040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 103/202] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/role_assignments?user.id=280c6c3592b6458fac036c97b13ffa02&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:20.319040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.331343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085b306-7a3f-4a19-a13c-a1e7eee255d2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.387010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.387819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.388038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.388305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.465296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776deb-4a66-470c-96a7-26703a7741dc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.471491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.472978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.481740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.510396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.511368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.511790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.512228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.562017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.610725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 100/203] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:20.616627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.617756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.620085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.770706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78200-8a8c-4af6-acb2-96fb86fd154c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:20.779479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:20.827731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 104/204] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:20.835968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.841458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:20.842281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:20.842689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:20.843133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:20.855913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:20.857734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:20.868069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 101/205] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:20.879883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:20.916538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:21.012249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615d81-6bfa-4e0f-9e0f-a545a1fdb2d7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:21.044732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52a783-fef4-4df8-9d75-00b4e18b18c6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:21.079752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:21.080364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:21.080647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:21.080922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:21.081653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, scope.project.id=d257f8265ff0472286dbf1d886336b40, user.id=4568f8936d9041ba808d268bbfc650f1) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:21.081963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:21.083442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cffa0-4b2b-485f-bc58-550d13447452 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:21.083641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:21.084881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:21.085296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:21.085624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:21.086819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:21.088346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:21.090113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 102/207] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/role_assignments?user.id=4568f8936d9041ba808d268bbfc650f1&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e82ae19017b845a9a74604cba0f09157 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:21.090243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 105/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:20 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:21.095929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:21.228719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024948bc-2126-4203-af97-53fdd4440c4a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:21.262821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:21.281309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:21.281924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:21.282206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:21.282482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:21.283245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=280c6c3592b6458fac036c97b13ffa02) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:21.283560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:21.285011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd9ba3-3bfd-45ce-81db-b04bf3ce491d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:21.295363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 106/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:21 2022] GET /identity/v3/role_assignments?user.id=280c6c3592b6458fac036c97b13ffa02&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=d34b130893c44c4697b28b2f332822a6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:22.361774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874f12-9e88-4642-8d95-20dd2dde57f0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.362487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874f12-9e88-4642-8d95-20dd2dde57f0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.362487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874f12-9e88-4642-8d95-20dd2dde57f0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.363957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 103/209] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:22.370200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032292d0-9f9f-465b-adb9-50c1afcea9ad None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.370705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032292d0-9f9f-465b-adb9-50c1afcea9ad None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.370860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032292d0-9f9f-465b-adb9-50c1afcea9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.389296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-032292d0-9f9f-465b-adb9-50c1afcea9ad None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:22.390508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-032292d0-9f9f-465b-adb9-50c1afcea9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.459710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 107/210] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:22.522259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db789-bb9c-4caf-92b1-1c3a7aaa8db4 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.522900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db789-bb9c-4caf-92b1-1c3a7aaa8db4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.523423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db789-bb9c-4caf-92b1-1c3a7aaa8db4 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.525342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 104/211] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:22.530801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.531326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.531803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.550511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:22.552009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.564854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7721ff-3b55-4d87-a424-13b253ff858a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.565408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7721ff-3b55-4d87-a424-13b253ff858a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.565876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7721ff-3b55-4d87-a424-13b253ff858a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.567663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 105/212] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:22.576731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.576731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.576731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.592254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:22.593452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:22.626505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:22.640260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 108/213] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:22.673762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 106/214] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:22.744827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:22.797223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:22.859020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf16c-e832-4868-8373-2cd4b5fc9529 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:22.891277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:22.891876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:22.892158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:22.892428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:22.903921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:22.908790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:22.909648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:22.910457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 109/215] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:22.916470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:22.919785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.029969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127ea67-52f1-4522-9763-2167f3514b0c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.030299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdbaf-a368-4e19-b2ce-0d675e7c8b3b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.039637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.071637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.071983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.072251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.072528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.072621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.072804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.072895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.073084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.073499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:23.073801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.075213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.083752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 110/216] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:23.085205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.089394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:23.094348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:23.100230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 107/217] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:23.101264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.126751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.204377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184d9b-4a6f-4531-a4d9-35fff642bddc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.204728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1861-e159-46c5-8d29-1412d88329b5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.240747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.241518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.241805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.242080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.242365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.243018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.243238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.243358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.243568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.244708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.244803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.246162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.246544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 111/218] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.247224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.252271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 108/219] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.253043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.290867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.352836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.359389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2b2f-39b6-4953-8425-e2604c246a99 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.360745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286a5d-a435-455e-9e23-4b0e061b4196 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.394486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390393-3076-4070-938b-8966fd18e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.395102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.395473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390393-3076-4070-938b-8966fd18e50d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.395550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.395617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390393-3076-4070-938b-8966fd18e50d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.395680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.395743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390393-3076-4070-938b-8966fd18e50d None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.395844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.396301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390393-3076-4070-938b-8966fd18e50d None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:23.396509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.396668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390393-3076-4070-938b-8966fd18e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.398088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390393-3076-4070-938b-8966fd18e50d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.398194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52055b9-1019-4649-9751-37998c34cca4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.406127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 112/220] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.406917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390393-3076-4070-938b-8966fd18e50d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.420171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 109/221] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:23.421547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e81-f8f9-400d-a918-1184fac61725 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.421836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e81-f8f9-400d-a918-1184fac61725 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.422109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e81-f8f9-400d-a918-1184fac61725 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.423522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 110/222] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:23.428598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05807e81-f8f9-400d-a918-1184fac61725 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.533636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.538200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390393-3076-4070-938b-8966fd18e50d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.545564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05807e81-f8f9-400d-a918-1184fac61725 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.576787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.577428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.578497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.578497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.579736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.581227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce412071-1726-40b9-9231-6e662bb1fb78 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.583934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 113/223] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.584646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.585295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.585295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.589900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.590532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.590815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.591118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] PATH_INFO: `/v3/users/259057448b764baa8174b9849b2a17af` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.604066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:23.605271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:23.607192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] RBAC: Authorizing `identity:get_user(user_id=259057448b764baa8174b9849b2a17af)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.608660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.610324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 111/224] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/users/259057448b764baa8174b9849b2a17af => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:23.611435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.625463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.695466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 114/225] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:23.696330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:23.746339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ad83-e7f1-42a6-8f69-fd85fbc0460d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.794294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.795302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.795767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.796221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/users/280c6c3592b6458fac036c97b13ffa02/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.798892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, user_id=280c6c3592b6458fac036c97b13ffa02, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.801141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:23.819495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 112/226] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:23 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/users/280c6c3592b6458fac036c97b13ffa02/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:23.826584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:23.835417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb7df-d6bb-4bd9-b1b7-48dc53322a1b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:23.876508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:23.877149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:23.877431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:23.877707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:23.954956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:23.956546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.010072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.070797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:24.079306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 115/227] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:24.085050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.141057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:24.219387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79334b15-56a5-436d-b5f3-20aafdfa42ac None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.227464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486cb4b-d771-44e6-a702-45883f2313f7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.260677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.261604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.261889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.262159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.263387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:24.265382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.267375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 116/228] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:24.274254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.317020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.317669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.317949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.318221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.330187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:24.335679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:24.336549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:24.337344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 113/229] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:24.346371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.347886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:24.390201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68916-ec56-49fd-9113-41736cb49b9e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.429517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.430290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.430586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.430862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.431628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=259057448b764baa8174b9849b2a17af) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:24.431939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:24.433525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.439983 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 117/230] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/role_assignments?user.id=259057448b764baa8174b9849b2a17af&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:24.561254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a7891-8589-4b38-b6f0-9dad3695d655 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.591857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:24.597996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.598690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.598975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.599268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.600483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:24.600794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:24.602725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.611895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 114/231] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:24.618750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.751861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1077f33-923d-40fa-b5be-6630da1413b7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.782893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:24.791898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.792543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.792825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.793103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.794252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:24.795766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.797376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 118/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:24.802960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:24.912772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861063-1145-4f61-83d9-89d350d052ae None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:24.949109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:24.949749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:24.950030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:24.950310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:24.951470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:24.952991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090daa86-cf98-4845-8a69-a01555dabe00 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:24.954790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 115/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:24 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:24.960415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:25.074271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f3490-1c9e-4ee3-b507-1f04f07e520b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:25.108809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:25.109472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:25.109755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:25.110099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/users/280c6c3592b6458fac036c97b13ffa02/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:25.112922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, user_id=280c6c3592b6458fac036c97b13ffa02, role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:25.114386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed495-f867-4eb4-9259-5a2886bdcafc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:25.130366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 119/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:24 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/users/280c6c3592b6458fac036c97b13ffa02/roles/d34b130893c44c4697b28b2f332822a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:03:25.766155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc5175-51d0-49ee-8e53-2d30944d8e26 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:25.766668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc5175-51d0-49ee-8e53-2d30944d8e26 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:25.766741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc5175-51d0-49ee-8e53-2d30944d8e26 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:25.768385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 116/235] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:25.775416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f113b-8bde-46cc-b57c-a6f06ba1b346 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:25.775911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f113b-8bde-46cc-b57c-a6f06ba1b346 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:25.776354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f113b-8bde-46cc-b57c-a6f06ba1b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:25.808450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-322f113b-8bde-46cc-b57c-a6f06ba1b346 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:25.809655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-322f113b-8bde-46cc-b57c-a6f06ba1b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:25.887957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:25.907336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 120/236] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:25.940490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489f0-81ea-4125-bc0d-4ecdb954d7b1 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:25.941095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489f0-81ea-4125-bc0d-4ecdb954d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:25.941591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489f0-81ea-4125-bc0d-4ecdb954d7b1 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:25.943404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 117/237] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:25.948965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:25.949259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:25.949535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:25.976045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:25.977310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:26.055720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 121/238] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:26.363884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754489f0-81ea-4125-bc0d-4ecdb954d7b1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:26.442348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:26.453130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:26.496380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754489f0-81ea-4125-bc0d-4ecdb954d7b1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:26.532046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:26.533014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.533484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.534010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.545922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f7f5bd9a-46e4-4cbb-b4ec-207d139cec8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:26.551868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:26.552741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:26.554633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:26.556403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 118/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:26.561124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdceb-9253-4f4b-a3e3-f8f985db84e2 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.561124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdceb-9253-4f4b-a3e3-f8f985db84e2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.561124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdceb-9253-4f4b-a3e3-f8f985db84e2 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.561124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 119/240] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:26.562412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bdceb-9253-4f4b-a3e3-f8f985db84e2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:26.589508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9519b-234b-4deb-ad6a-4d6e5f09e225 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:26.612341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:26.639483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:26.640023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.640304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.640575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.641939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:26.644425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4fe5-df7a-45f7-9f78-b6e4a9c09a26 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:26.647822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 122/241] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:26.649314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.649603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.649877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.672937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:26.674286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:26.704829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bdceb-9253-4f4b-a3e3-f8f985db84e2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:26.731490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:26.755124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:26.755742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.756098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.756385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.757084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:26.757393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:26.759013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:26.764615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 123/242] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:26.765772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:26.776241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 120/243] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:26.782147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:26.906174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f5846-dc23-4bd3-95a7-aad5fc1e130b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:26.938591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:26.971929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:26.973482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:26.974221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:26.975288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:26.976157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:26.977097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772ec9-e12c-411d-8af4-e52448060b02 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:26.977926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73d72-5d7d-489c-88cb-c319dc7edaf1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.005767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 124/244] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:26 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:27.007999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514c40-baed-49aa-a1ec-bc16fd8ba6db None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.008382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514c40-baed-49aa-a1ec-bc16fd8ba6db None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.008800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514c40-baed-49aa-a1ec-bc16fd8ba6db None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.011004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 125/245] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:27.018415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.018757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.018964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.043758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.044524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.044807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.045080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] PATH_INFO: `/v3/users/46d9403a4e6c432e9d76da98473a7a5b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.062381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:27.064067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:27.077211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] RBAC: Authorizing `identity:get_user(user_id=46d9403a4e6c432e9d76da98473a7a5b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.078720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.082590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 121/246] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:26 2022] GET /identity/v3/users/46d9403a4e6c432e9d76da98473a7a5b => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:27.092152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.154436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.181441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 126/247] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:27.182931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.229074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14865a-eaaa-4583-aa6b-b9c588054291 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.280871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.281492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.282321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.282611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.310101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.313365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b742ec-aad4-4717-a27e-8c8f755d1b37 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.367719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.368368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.368648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.368911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.385943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.387770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.387879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:27.393313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:27.394217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:27.396346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 127/248] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:27.403240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.441152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.519265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 122/249] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:27.519938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.548374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ff78f-33ce-4cb5-8498-07470684fd6a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.595896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.596550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.596829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.597101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.599063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:27.599063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.599577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.613099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 128/250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:27.614384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.644206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.648501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902baf-039b-42f8-a72d-66c8eb553736 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.687626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.688617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.689100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.689601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.698740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.702364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-adab62e4-c628-404f-8356-635904b8b4ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:27.708462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:27.709611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:27.710509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:27.712842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 123/251] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:27.714415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537a37-ac61-45ec-80a7-1491eb03bc14 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.714964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537a37-ac61-45ec-80a7-1491eb03bc14 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.715487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537a37-ac61-45ec-80a7-1491eb03bc14 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.717582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 124/252] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:27.718601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537a37-ac61-45ec-80a7-1491eb03bc14 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.734570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ffc27-e595-4de2-a9d9-f7b4f9e22c77 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.771498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.772159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.772450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.772725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.773883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.775386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.777084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 129/253] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:27.777805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.836828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537a37-ac61-45ec-80a7-1491eb03bc14 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.874655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.878484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.879758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.880346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.880909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.883099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.884887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feba3c-301b-48e6-b6e0-ab10e61db883 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.886832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 125/254] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:27.886941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72b54-9b92-491f-9c76-a95b39278b48 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:27.888678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.889287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.889762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.911974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:27.913741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:27.922242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:27.922856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:27.923170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:27.923787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:27.924103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:27.924408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:27.925802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:27.935499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 130/255] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:27.936404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:27.989287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:27.997437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 126/256] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:27.998569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.082725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5fc3-2dde-44de-bc49-358a16887dee None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.112677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615ccb-8757-4a9e-a90c-f545d3ab6fe9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.144859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.145477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.145758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.146032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.147329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=46d9403a4e6c432e9d76da98473a7a5b) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:28.147735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:28.149327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:28.160148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.161716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.162482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.163309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.164828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 131/257] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/role_assignments?user.id=46d9403a4e6c432e9d76da98473a7a5b&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e82ae19017b845a9a74604cba0f09157 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:28.168652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.227373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:28.304721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:28.312889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:28.314419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:28.385432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97c95-a40e-42ad-8fad-c364138ce048 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.425529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.426176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.426567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.426853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] PATH_INFO: `/v3/users/259057448b764baa8174b9849b2a17af` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.428246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] RBAC: Authorizing `identity:get_user(user_id=259057448b764baa8174b9849b2a17af)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:28.429614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:28.431555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 132/258] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/users/259057448b764baa8174b9849b2a17af => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:28.432514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.496258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 127/259] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:28.500605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.525700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:28.544652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e625fa-d83d-45b2-83cf-770d2f536542 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.581094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.581653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.581932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.582202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.593263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:28.598619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:28.599540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 133/260] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:28.601821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.716094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922613-54a3-4c30-842d-2560c55281f2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.728768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:28.735291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47990c-2757-4d03-a703-ae39f4a2fdd8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.751994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.752637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.752914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.753187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.754323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:28.755809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:28.758112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 134/261] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:28.759046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.775261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:28.818701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.819557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.819847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.820124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.827693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:28.829194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:28.831071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 128/262] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:28.835191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:28.925501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd51db-e4c4-420f-841e-6b5e24d4b228 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:28.993663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:28.995481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:28.996719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:28.997192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:28.998250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:28.999928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:29.001589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:29.023662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 135/263] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:29.025479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:29.039182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9c740-e864-47fc-af28-14ad9013b687 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:29.121449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:29.150994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271659-9508-40b7-b07e-70daf50cb45d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:29.160238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:29.160869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.161154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.161434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.162180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=280c6c3592b6458fac036c97b13ffa02) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:29.162577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:29.164187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:29.178493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 129/264] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:28 2022] GET /identity/v3/role_assignments?user.id=280c6c3592b6458fac036c97b13ffa02&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:29.179076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:29.192122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:29.194124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.194818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.195313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/users/259057448b764baa8174b9849b2a17af/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.197782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, user_id=259057448b764baa8174b9849b2a17af, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:29.199592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:29.222319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 136/265] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:29 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/users/259057448b764baa8174b9849b2a17af/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:29.240757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:29.326308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fe3b-3354-4e28-9b04-eb111bd9a58e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:29.375141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:29.376178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.376724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.377206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] PATH_INFO: `/v3/users/280c6c3592b6458fac036c97b13ffa02` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.383939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] RBAC: Authorizing `identity:get_user(user_id=280c6c3592b6458fac036c97b13ffa02)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:29.385767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a9391-b28f-401b-9610-af5bf8a16c73 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:29.387889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 130/266] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:29 2022] GET /identity/v3/users/280c6c3592b6458fac036c97b13ffa02 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:29.394502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:29.532916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec49c-c203-438b-aba9-f718ff9350b3 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:29.572743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:29.573733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.574210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.574696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.577798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:29.624979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f13f-453a-44e3-baa0-5259477bcbbb None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.625462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f13f-453a-44e3-baa0-5259477bcbbb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.625784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898f13f-453a-44e3-baa0-5259477bcbbb None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.629041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 131/267] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:29.634532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856be7-e4c3-4334-8e55-01a57a415de0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.634936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856be7-e4c3-4334-8e55-01a57a415de0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.635361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856be7-e4c3-4334-8e55-01a57a415de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.662555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6f856be7-e4c3-4334-8e55-01a57a415de0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:29.662555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6f856be7-e4c3-4334-8e55-01a57a415de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:29.667471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:29.669127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:29.753735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 132/268] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:29.847999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f959-5495-40c2-aa54-47b1cc3046eb None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.848294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f959-5495-40c2-aa54-47b1cc3046eb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.848576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f959-5495-40c2-aa54-47b1cc3046eb None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.852875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 133/269] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:29.859705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:29.859992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:29.860270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:29.890567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:29.893811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:29.907718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 137/270] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:29.919947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:29.927546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:29.976871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 134/271] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 16:03:30.008050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.080085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449369-eb6b-47fb-b722-d5f683f827a2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.115017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.128595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.129242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.129527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.129881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.130966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.132989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.134641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 138/272] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:29 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:30.140836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.254715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe82ce-8129-44b6-8dcb-329079ecf637 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.290647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.291411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.291800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.292083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.293205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.294781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.296761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 135/273] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:30.301745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.319529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ee09-a3cd-449b-af10-9b74a0694e4b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.321353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.343463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.363025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.363676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.363957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.364282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.365024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=280c6c3592b6458fac036c97b13ffa02) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:30.366206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.367823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.374538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 139/274] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/role_assignments?user.id=280c6c3592b6458fac036c97b13ffa02&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=d34b130893c44c4697b28b2f332822a6 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:30.379482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.437645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edf51a-8661-4b52-af0e-4183498b61f3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.480901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.482031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.482498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.482925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.483772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.485422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.522525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 136/275] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:30.567047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed58060-f555-403c-8269-ee6de27a40fe None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.613348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.614262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.614549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.614824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.631578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:30.637087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:30.637941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:30.638810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 140/276] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:30.648517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.751219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.772540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005665df-6787-4d65-9e8f-0275f5a681d7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.812179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:30.812800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.813084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.813358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.814035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:30.814350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:30.815770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe03-b4d9-4b65-9a4a-aa33b0c741f9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:30.827046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 137/277] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:30.836103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:30.868508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e001-d3a6-4042-9f87-ce81359718e6 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.869021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e001-d3a6-4042-9f87-ce81359718e6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.869443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e001-d3a6-4042-9f87-ce81359718e6 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.870970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 138/278] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:30.878246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:30.878885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:30.879446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:30.879817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:30.900597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:30.901785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:30.969628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d26-7695-4e57-8678-352884182a0d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:30.983970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 139/279] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:31.013680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.014238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.014519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.014788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] PATH_INFO: `/v3/users/a337194ab51a4262b2fcf89e58d9c840` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.029313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] RBAC: Authorizing `identity:get_user(user_id=a337194ab51a4262b2fcf89e58d9c840)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.030913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.032936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 141/280] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:30 2022] GET /identity/v3/users/a337194ab51a4262b2fcf89e58d9c840 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:31.039069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.123638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:31.153453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04150-d11e-4cc2-b69b-8fd0ce3a70b9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:31.194348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.195385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.195863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.196348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.197275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, user.id=a337194ab51a4262b2fcf89e58d9c840, scope.system=all) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:31.197828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.203571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.210438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 140/281] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Aug 30 16:03:31 2022] GET /identity/v3/role_assignments?user.id=a337194ab51a4262b2fcf89e58d9c840&scope.system=all&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:31.399106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.509722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:31.529832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43af5-1ede-4098-97e9-bcc2d79b5901 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:31.563989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.564622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.564905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.565178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.576220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9ca6be13-fb96-4dbb-a807-a485b675c563 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:31.581087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:31.581998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:31.582796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:31.587135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 142/282] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:31.589032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.661187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962713e-89dd-48c9-bbfd-212a762c885f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.661475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962713e-89dd-48c9-bbfd-212a762c885f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.661733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962713e-89dd-48c9-bbfd-212a762c885f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.663466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 143/283] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:31.673338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.673679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.673966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.703530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:31.704790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:31.750250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082056e0-688d-4e27-83cc-55035f33d70e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:31.795068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:31.795683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:31.795967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:31.796245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:31.796917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:31.797225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:31.798607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:31.808436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:31.822502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 141/284] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:31.823879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:31.859654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 144/285] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:31.986332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92220a-f831-45c5-a994-e3e991116e6c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.026501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.027170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.027457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.027735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] PATH_INFO: `/v3/users/46d9403a4e6c432e9d76da98473a7a5b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.028907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] RBAC: Authorizing `identity:get_user(user_id=46d9403a4e6c432e9d76da98473a7a5b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:32.030351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:32.032277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 142/286] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:31 2022] GET /identity/v3/users/46d9403a4e6c432e9d76da98473a7a5b => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:32.038715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:32.149273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:32.185227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596e48-4886-41bd-934e-f745785c6eec None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.234063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.234696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.234998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.235279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.236832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:32.238281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:32.239934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 145/287] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:32 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:32.245973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:32.318120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:32.369393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:32.415533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0c0d-4665-4f6e-b923-76404dbf87ca None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.450702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.451453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.451735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.452063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/users/46d9403a4e6c432e9d76da98473a7a5b/roles/e82ae19017b845a9a74604cba0f09157` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.456365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, user_id=46d9403a4e6c432e9d76da98473a7a5b, role_id=e82ae19017b845a9a74604cba0f09157)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:32.457917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:32.483009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 143/288] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:03:32 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/users/46d9403a4e6c432e9d76da98473a7a5b/roles/e82ae19017b845a9a74604cba0f09157 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:32.517671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ef969-ed7f-401d-a13d-63010ea00cd0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.562635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.563323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.567549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.567859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.583640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:32.589160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:32.590110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:32.590895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 146/289] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:32.598366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:32.730475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32408c8-bc33-4a0f-abad-d150b107f602 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.761671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:32.769987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.771126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.771794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.772064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.772749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:32.773594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:32.775088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:32.784392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 144/290] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:32.791121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:32.794069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:32.913697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38341074-e0ca-4f2c-80f3-561f82d27b9b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:32.954570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:32.955273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:32.955618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:32.955897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] PATH_INFO: `/v3/users/259057448b764baa8174b9849b2a17af` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:32.959724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] RBAC: Authorizing `identity:get_user(user_id=259057448b764baa8174b9849b2a17af)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:32.961216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42046c-edd1-4f43-b18b-c72683e44364 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:32.962826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 147/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:32 2022] GET /identity/v3/users/259057448b764baa8174b9849b2a17af => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:32.968875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.078639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf640-1095-4da6-afcb-94596eb1bb27 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.079145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf640-1095-4da6-afcb-94596eb1bb27 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.079145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf640-1095-4da6-afcb-94596eb1bb27 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.080526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 148/292] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:33.085496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9f6f-4dfb-4c1c-8250-a2a2335cde96 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.085782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9f6f-4dfb-4c1c-8250-a2a2335cde96 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.086060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9f6f-4dfb-4c1c-8250-a2a2335cde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.116751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f91c9f6f-4dfb-4c1c-8250-a2a2335cde96 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:33.117959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f91c9f6f-4dfb-4c1c-8250-a2a2335cde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:33.134942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1696e-14bb-4287-9dad-938d403d2a91 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.210822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:33.211474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.211759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.212036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.214673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:33.220991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 149/293] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:33.222543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00230-8af7-44c0-84fc-65c610006dd4 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.223045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00230-8af7-44c0-84fc-65c610006dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.223531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e00230-8af7-44c0-84fc-65c610006dd4 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.225026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 150/294] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:33.232633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.233166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.233630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.270584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:33.272706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:33.285546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:33.299904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:33.301613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:33.383150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 151/295] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:33.445342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 145/296] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:33.451004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.525965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.584588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952975a1-93e7-49d3-a6f4-4f8bef19e838 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.639424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:33.648748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:33.649386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.649660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.649929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.651256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:33.652709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:33.658266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 152/297] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:33 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:33.663776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.727598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:33.739569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f53a9-84cb-4b85-8510-0e87e5f9786f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.776965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:33.777831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.778634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.779064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.780319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:33.782451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:33.784377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 146/298] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:33.785495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.805997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9666-3850-4fc5-96a2-e666bd3782cd None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.851987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:33.853006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.853513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.853991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.854929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=259057448b764baa8174b9849b2a17af) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:33.855502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:33.857176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:33.871027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 153/299] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:33 2022] GET /identity/v3/role_assignments?user.id=259057448b764baa8174b9849b2a17af&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:33.871027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:33.915462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa718b7-5818-4278-95a5-a2f4568466d0 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.950295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:33.970487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:33.971834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:33.972275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:33.972986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:33.989720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:33.996806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcd06e-17ca-4e73-99c7-e4b9a9ac5dc6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-fe65b69e-85d6-40d2-b45d-e667216a55b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:33.997598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:33.998673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:33.999558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:34.002052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 147/300] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:34.002687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-1930-4e07-b977-4892f63dd257 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.002969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-1930-4e07-b977-4892f63dd257 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.007363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-1930-4e07-b977-4892f63dd257 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.010971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 148/301] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:34.012405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5e23-1930-4e07-b977-4892f63dd257 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.033697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.045622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.046442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.046872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.047326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] PATH_INFO: `/v3/groups` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.047964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:34.049672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e93c7b-f173-47df-8878-dd3fec48a2ed None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:34.068014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 154/302] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Aug 30 16:03:33 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:34.069815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.070197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.070556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.092673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:34.093944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:34.152502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5e23-1930-4e07-b977-4892f63dd257 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:34.181283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 155/303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:34.209803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.210441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.210725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.211033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.211836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:34.212141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:34.213554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:34.223620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 149/304] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:34.229282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.288326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.341161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2edc-4c66-4923-a350-6456bffcb57d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:34.377028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.377659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.377937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.378207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] PATH_INFO: `/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.392038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b3fe00e4ad40209aaf22ff0cb182f4)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:34.393500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:34.395448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 156/305] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:34.401618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.486560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.495840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.508372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c83651-6a8b-41ae-bcb1-fbac29e8b507 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:34.553202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.553871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.554157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.554430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.555433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, user.id=f8b3fe00e4ad40209aaf22ff0cb182f4, scope.system=all) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:34.555750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:34.557651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:34.567018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 150/306] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/role_assignments?user.id=f8b3fe00e4ad40209aaf22ff0cb182f4&scope.system=all&role.id=e82ae19017b845a9a74604cba0f09157 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:34.627281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c132-8f22-4e3f-bf03-0a2ab7d7d184 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:34.640263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.668167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.668815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.669109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.669388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.681829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ca47597b-c0e5-46d7-99c7-beac7ead96c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:34.686827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:34.687765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:34.688569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 157/307] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:34.695713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.754923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e66e-1a98-4f4d-9ff5-b4e119e46f72 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.755250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e66e-1a98-4f4d-9ff5-b4e119e46f72 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.755435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e66e-1a98-4f4d-9ff5-b4e119e46f72 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.757372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 158/308] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:34.762957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.763391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.763784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.786737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:34.788560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:34.808713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386d59-3716-4caf-b18d-118da15d0a2e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:34.856964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:34.857593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:34.857878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:34.858156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:34.858840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:34.859171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:34.860568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:34.878390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 151/309] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:34.879898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:34.887343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 159/310] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:34.889514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.987512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ebbf-00c8-4649-a723-30b2c16098ad None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.027390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.027948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.028234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.028517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] PATH_INFO: `/v3/users/a337194ab51a4262b2fcf89e58d9c840` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.029717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] RBAC: Authorizing `identity:get_user(user_id=a337194ab51a4262b2fcf89e58d9c840)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:35.031186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:35.033110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 152/311] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:34 2022] GET /identity/v3/users/a337194ab51a4262b2fcf89e58d9c840 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:35.038393 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:35.146445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:35.151668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ae3cc-5054-4507-9071-ce467ee74396 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.174487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:35.186442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.187124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.187404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.187984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] PATH_INFO: `/v3/system/users/a337194ab51a4262b2fcf89e58d9c840/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.189151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a337194ab51a4262b2fcf89e58d9c840, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:35.190671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:35.201883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 160/312] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Aug 30 16:03:35 2022] PUT /identity/v3/system/users/a337194ab51a4262b2fcf89e58d9c840/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:03:35.273725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:35.307067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac12b-e90e-4afc-b7b5-f0b66cf51e90 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.344321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.345314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.345794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.346261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.357922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:35.363463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:35.364338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:35.365136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:35.369846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 153/313] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:35.371220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:35.487718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb802aa-bcc0-4765-b525-fed727999a81 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.524229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.525202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.525687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.526162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.527143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:35.527664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:35.529279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:35.539491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:35.548101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:35.660162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d6a2-08eb-4e52-bab1-e2c5a8328808 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.696871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.697853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.698365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.698842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] PATH_INFO: `/v3/users/46d9403a4e6c432e9d76da98473a7a5b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.700232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] RBAC: Authorizing `identity:get_user(user_id=46d9403a4e6c432e9d76da98473a7a5b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:35.701877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:35.703704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 154/315] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:35 2022] GET /identity/v3/users/46d9403a4e6c432e9d76da98473a7a5b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:35.712103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:35.745401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:35.827352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f8fa-2b78-4689-89ab-077ced55dc8a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:35.864279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:35.865171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:35.866213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:35.866699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:35.938361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:35.940185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4486a-e25a-4a32-acc4-3b6da7a51c6b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:35.967243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.046722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:36.052164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:36.055314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.142217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db06f-c28c-4ba4-97d4-698e1eb9c502 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.142555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db06f-c28c-4ba4-97d4-698e1eb9c502 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.142768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db06f-c28c-4ba4-97d4-698e1eb9c502 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.144393 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 163/317] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:36.149757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7725e-152f-4204-b765-b06230bca544 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.150309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7725e-152f-4204-b765-b06230bca544 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.150309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7725e-152f-4204-b765-b06230bca544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.170048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c928-fc8d-4194-ade9-07a191336e88 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:36.170515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-21b7725e-152f-4204-b765-b06230bca544 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:36.171748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-21b7725e-152f-4204-b765-b06230bca544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:36.218486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:36.219718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.220000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.220276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.221516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:36.223264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:36.226141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 155/318] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:36 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:36.231079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:36.267070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 164/319] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:36.317958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.357759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371132-d00d-47c8-9945-c30a98359cc0 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:36.395697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:36.396546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.397501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.397914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.398782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, scope.project.id=a88306b3abe9448cb02665940375ce17, user.id=46d9403a4e6c432e9d76da98473a7a5b) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:36.399347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:36.400928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695eb91-70e4-4a58-97f4-f7c7eefa4641 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:36.407404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 156/320] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:03:36 2022] GET /identity/v3/role_assignments?user.id=46d9403a4e6c432e9d76da98473a7a5b&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e82ae19017b845a9a74604cba0f09157 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:36.568351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7725e-152f-4204-b765-b06230bca544 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:36.586524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6643-e369-4331-b9f8-d433b674fb66 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.587105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6643-e369-4331-b9f8-d433b674fb66 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.587185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6643-e369-4331-b9f8-d433b674fb66 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.588722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 157/321] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:36.593664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.593949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.594221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.614409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:36.615892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:36.629896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.682784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7725e-152f-4204-b765-b06230bca544 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:36.691015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 158/322] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:36.720694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:36.721327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.721609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.721885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.722997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:36.724454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:36.726730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 165/323] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:36.732067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:36.795751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:36.835785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437691-786a-4c5c-b7e6-aa682c228ae1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:36.876783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:36.877392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:36.877668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:36.877937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] PATH_INFO: `/v3/groups` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:36.878572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:36.880165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:36.898006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 159/324] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Aug 30 16:03:36 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:03:36.976615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.088103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825739f-7b55-499a-8fbc-3dcb1cdfed77 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.112543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:37.124708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.125345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.125627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.125901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.136781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-1d18b44c-e568-4e74-b83f-14753a7e99fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:37.141661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:37.142713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:37.143620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 166/325] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:37.150712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.233125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86e7b-87c5-48f3-84c9-2783921d96d4 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.233975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86e7b-87c5-48f3-84c9-2783921d96d4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.234471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86e7b-87c5-48f3-84c9-2783921d96d4 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.236141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 167/326] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:37.244007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.244293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.244572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.263315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:37.264537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:37.272843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801b4f-bd5f-461d-9663-39cfa1efe389 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.299949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:37.315904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.316527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.316806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.317079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.317759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:37.318066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:37.320366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:37.330468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 160/327] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:37.335909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.350654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 168/328] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:37.444503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ccc83-e99b-48a6-bf93-6a00b8f1e73b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.480620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.481617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.482104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.482579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] PATH_INFO: `/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.483995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b3fe00e4ad40209aaf22ff0cb182f4)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:37.485672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:37.488084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 161/329] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:37 2022] GET /identity/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:37.493572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.619643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae033c-e0cd-49eb-99e4-45f169657279 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.633077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.637431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:37.672641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.673925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.674828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.675684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] PATH_INFO: `/v3/system/users/f8b3fe00e4ad40209aaf22ff0cb182f4/roles/e82ae19017b845a9a74604cba0f09157` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.679786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8b3fe00e4ad40209aaf22ff0cb182f4, role_id=e82ae19017b845a9a74604cba0f09157)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:37.681445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:37.692398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 169/330] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Aug 30 16:03:37 2022] PUT /identity/v3/system/users/f8b3fe00e4ad40209aaf22ff0cb182f4/roles/e82ae19017b845a9a74604cba0f09157 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:37.726096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:37.782096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a294c4-68f8-487e-b7bf-58eb9b5e1dc6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:37.821402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:37.822059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:37.822342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:37.822614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:37.834727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:37.842744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:37.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:37.844503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 162/331] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:37.847574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:37.977965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680791d6-107b-4712-beb8-abcc07602c3b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:38.021677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:38.022717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:38.023122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:38.023518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:38.024296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:38.024701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:38.026213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:38.039892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 170/332] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:38.045043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:38.165833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872fe7-7739-4203-bffb-6181dc769777 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:38.191149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:38.220808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:38.221450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:38.221736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:38.222014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] PATH_INFO: `/v3/users/a337194ab51a4262b2fcf89e58d9c840` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:38.224688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] RBAC: Authorizing `identity:get_user(user_id=a337194ab51a4262b2fcf89e58d9c840)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:38.226808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0fc40-26aa-4df5-93c5-789b59fa646e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:38.228694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 163/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:38 2022] GET /identity/v3/users/a337194ab51a4262b2fcf89e58d9c840 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:38.234424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:38.298305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:38.376169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670098b6-ae4c-43dc-864f-8a252b71a274 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:38.420313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:38.421304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:38.421789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:38.422366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:38.423327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] RBAC: Adding query filter params (role.id=e635c23c0fae471ea6d0f2de2d71799f, user.id=a337194ab51a4262b2fcf89e58d9c840, scope.system=all) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:38.423842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:38.425492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a7108-ec7a-447d-97cb-457ed6c0d78b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:38.440446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 171/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Aug 30 16:03:38 2022] GET /identity/v3/role_assignments?user.id=a337194ab51a4262b2fcf89e58d9c840&scope.system=all&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:39.266621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c7c-c918-431a-9fed-41ce30d9910c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:39.267190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c7c-c918-431a-9fed-41ce30d9910c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:39.267190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c7c-c918-431a-9fed-41ce30d9910c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:39.268854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 164/335] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:39.276070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:39.276554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:39.276630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:39.306053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:39.308270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:39.404438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 172/336] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:39.809896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee9c7c-c918-431a-9fed-41ce30d9910c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:39.948659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee9c7c-c918-431a-9fed-41ce30d9910c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:39.993058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:39.993706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:39.993992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:39.994268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.005579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-566a166d-4b00-4191-b196-fd63486d2043 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:40.015350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:40.016316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:40.017103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:40.017711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 165/337] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:40.025100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:40.061829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:40.105578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf530c-7856-43d3-9177-0366ba0376c6 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.105880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf530c-7856-43d3-9177-0366ba0376c6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.106144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf530c-7856-43d3-9177-0366ba0376c6 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.107772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 166/338] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:40.121064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a2f1-d7a3-4768-ba98-c9c0bbea5952 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.121478 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a2f1-d7a3-4768-ba98-c9c0bbea5952 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.121623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a2f1-d7a3-4768-ba98-c9c0bbea5952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.160312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97910f5-cf71-45bb-9cb4-4025d46551a9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:40.164894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9de0a2f1-d7a3-4768-ba98-c9c0bbea5952 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:40.166118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9de0a2f1-d7a3-4768-ba98-c9c0bbea5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:40.218389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:40.219392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.219899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.220371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.221241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:40.221743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:40.223343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:40.242646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 173/339] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:40.248530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:40.276080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:40.348577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 167/340] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:40.422179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:40.435534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9fe71-a0d3-46e4-ba8d-bdc15551d596 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:40.491624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:40.492625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.493108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.493578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.558113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968f42-4acd-4200-b0ef-bb1e73ed2503 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.558763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968f42-4acd-4200-b0ef-bb1e73ed2503 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.559268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968f42-4acd-4200-b0ef-bb1e73ed2503 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.561024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 168/341] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:40.575927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:40.576588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38f1f-7a9c-4d3b-a823-331cc47777c3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.576876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38f1f-7a9c-4d3b-a823-331cc47777c3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.577153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38f1f-7a9c-4d3b-a823-331cc47777c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.577603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:40.620364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3bb38f1f-7a9c-4d3b-a823-331cc47777c3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:40.621492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3bb38f1f-7a9c-4d3b-a823-331cc47777c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:40.702318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:40.706389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 174/342] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:40.713492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:40.810341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 169/343] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:40.811663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa86f7-ebef-4d40-b477-457b772ee6ec None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.812195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa86f7-ebef-4d40-b477-457b772ee6ec None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.812602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa86f7-ebef-4d40-b477-457b772ee6ec None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.814215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 170/344] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:40.815098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa86f7-ebef-4d40-b477-457b772ee6ec None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:40.852494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbf96-13ef-4045-a587-9c4d0f681e9d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:40.889581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:40.890498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.890916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.891361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.892624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:40.894227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e9e1-a16e-4fcc-9a83-06c9a33d09e0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:40.897450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 175/345] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:40 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:40.898753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:40.899217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:40.899629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:40.920619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:40.922069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:40.978078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:40.994475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 176/346] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:40.995602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.017390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa86f7-ebef-4d40-b477-457b772ee6ec None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.023383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.090907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.091705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.092057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.092401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.103153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b143c5-07bf-462d-b2f3-e52c33941435 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.138829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.139868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.140324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.140730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:41.140965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:41.145806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:41.146676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:41.147571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:41.150483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:41.152239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:41.154106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 177/347] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:40 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:41.154514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 171/348] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:41.160130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.172069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.226754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.272066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3a14-dd85-4753-9474-353b86b865f7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.310779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.311657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.312082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.312597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.313537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=d257f8265ff0472286dbf1d886336b40) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:41.314001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:41.315662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:41.323508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 178/349] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:41.324804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.455944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779625-7d99-48fa-8126-9b3bd246595e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.495245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188fc44-ff88-46d8-b6d6-0dab29d853c9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.497744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.536487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.538352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.538775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.539269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.540376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:41.540931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:41.542610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:41.545251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.546208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.546690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.547203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.557200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 172/350] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:41.558041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.571532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:41.576874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:41.577796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 16:03:41.578620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:41.579810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 179/351] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:41.581103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.599453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.676686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3bda-77d6-48bf-87ce-a139dd31fa74 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.703577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6897-5969-4de2-9b07-6709552d991f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.714705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.715301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.715572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.715836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.730301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:41.736536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:41.737669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:41.738463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 173/352] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:41.739609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.747618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.748387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.748733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.749093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.799434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.826272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:41.827919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21cc4-5d90-4d53-add7-f96814d57ca7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:41.839387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:41.857305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52575f7-9d37-4108-a94f-2230855a2892 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:41.901053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:41.901774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.902062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.902336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.903029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:41.903602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:41.905256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bfdf-58cb-45d2-a734-4712d5ed66ad None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:41.916212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 174/353] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:41.917546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc632b3-0e5b-453b-8661-2b4e15de041c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.917902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc632b3-0e5b-453b-8661-2b4e15de041c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.918247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc632b3-0e5b-453b-8661-2b4e15de041c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.919791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 175/354] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:41.920591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc632b3-0e5b-453b-8661-2b4e15de041c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:41.954963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 180/355] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:41.956801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:41.957091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:41.957367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:41.981897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:41.983152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:42.051790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc632b3-0e5b-453b-8661-2b4e15de041c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.064203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 181/356] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:42.065133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.076556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.097752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.099154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.099742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.100892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.102221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:42.103188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.104798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.115092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 176/357] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.116966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.131926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.230762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49551-dc67-4c8d-b965-9ced8ae60094 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.269787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.270726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.271235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.271703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.274062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.275767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.279087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 177/358] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.280718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.295804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034976e-4444-42cf-8b36-838221eb0953 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.333792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.334952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.335343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.335824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] PATH_INFO: `/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.337053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b3fe00e4ad40209aaf22ff0cb182f4)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.338502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.340558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 182/359] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/users/f8b3fe00e4ad40209aaf22ff0cb182f4 => generated 293 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.341395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.379612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.414446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970706d-8ca8-4c5e-a88d-462ce5495f46 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.436729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.460574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.462355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.462355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.462355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.466401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3333-a783-435c-9cc9-78a5a0e0f173 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.509739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.509941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.510187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.510462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.511650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.513111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b94a3-c587-48e5-b13d-d9c154117376 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.514870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 183/360] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.515982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4cc-8742-42c9-b946-3f10d8ff2fbe None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.516271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4cc-8742-42c9-b946-3f10d8ff2fbe None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.516550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4cc-8742-42c9-b946-3f10d8ff2fbe None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.518001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 184/361] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:42.518709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc4cc-8742-42c9-b946-3f10d8ff2fbe None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.557853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.560677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.661183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc4cc-8742-42c9-b946-3f10d8ff2fbe None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.664818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.695757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 178/362] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:42.696449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.706149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.706763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.707076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.707354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.708206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] RBAC: Adding query filter params (role.id=e82ae19017b845a9a74604cba0f09157, user.id=f8b3fe00e4ad40209aaf22ff0cb182f4, scope.system=all) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:42.709226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.710086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.724788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:42.730726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 185/363] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/role_assignments?user.id=f8b3fe00e4ad40209aaf22ff0cb182f4&scope.system=all&role.id=e82ae19017b845a9a74604cba0f09157 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.731637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.831145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebc6-2da5-4415-a817-fce5cff72356 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.880899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.882085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.882369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.882644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.885627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806c855-78c7-4a0d-9393-51ce6ef89807 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:42.897117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-68c07730-c616-4869-9df4-21efa4e3008c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:42.902142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:42.903059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 179/364] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:42.909002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.909744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.909744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.932637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:42.933453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:42.933891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:42.934082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:42.934365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:42.934646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:42.935418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=d257f8265ff0472286dbf1d886336b40) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:42.935731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:42.938246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:42.948442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 186/365] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=d34b130893c44c4697b28b2f332822a6 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:42.949640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:42.972671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.039079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 180/366] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:43.040212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.051433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.099124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822a95-4108-4987-aa3a-e322fffe5b65 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.143544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.144229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.144518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.145069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.146305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.148847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.150830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 187/367] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:42 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:43.159013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.276308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a050fa5-91c9-433e-9299-645e50a07325 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.314107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.314804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.314909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbff75-219e-46b8-b45e-a91cf86171d1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.315122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.315448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.316872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.317377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.323762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.325987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 188/368] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:43.336054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.381952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.382492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.382763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.383055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.383737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:43.384043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.385427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.402513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 181/369] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:43.407166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.449626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.491851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31c6b-3455-43e0-a16b-1eec764bb3b5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.529824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.530780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.531301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.531860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.533469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=a88306b3abe9448cb02665940375ce17) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:43.534218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.536426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.540132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b547-1444-461a-8fff-5808ef8bdf41 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.544949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 189/370] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:43.545998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.597053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.597710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.597980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.598256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.613486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:43.626075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:43.627049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:43.627844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 182/371] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:43.630883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.644307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.681057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011030e3-0e86-4131-a854-dbaf9fd91adf None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.723355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.723981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.724314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.724588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.771642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.789400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb65c3-f0b7-47b8-bf05-af1adb22ec11 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:43.832639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.835146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:43.835543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.836033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.836408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.836799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.837571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:43.837969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:43.839992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806ce7b-9e21-4abb-8ef2-8c26b5fe3b22 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:43.851286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 183/372] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:43.852708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824778b-596e-4124-b246-2e3ee17cf634 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.853093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824778b-596e-4124-b246-2e3ee17cf634 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.853467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824778b-596e-4124-b246-2e3ee17cf634 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.855008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 184/373] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:43.860099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:43.860505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:43.860884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:43.882070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:43.883522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:43.920208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:43.958837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 185/374] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:43.963941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:43.972702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 190/375] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:43.978741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.091231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.134047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91819a55-dc6b-482a-89da-6a424a8db61a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.170013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4161c6-079d-4408-b60e-b0e777345321 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.203718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.204339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.204614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.204883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.243572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.244204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.244481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.244752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.248832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.250280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.251942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 191/376] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:44.258485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.322690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.333430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.334973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.405357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21cee-92a6-4306-9031-bc9385743bd0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.427640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.443731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.445146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.445440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.445719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.446851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.448585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.451643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 192/377] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:44.452496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.458456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 186/378] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:44.459396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.565575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0bce1-3c8a-4d8d-b712-bac19d833779 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.566340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625fba-db1f-419a-918a-ec9fa9b27544 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.599276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.602015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.602713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.602925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.603226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.603964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=a88306b3abe9448cb02665940375ce17) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:44.604269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.605706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.607606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.608256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.608647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.608937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.611678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 187/379] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=d34b130893c44c4697b28b2f332822a6 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:44.612796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.621638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:44.627060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:44.628028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:44.628927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:44.637079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 193/380] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:44.639415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.686034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.757456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7af-4bc7-40fd-b29e-102f6e89916f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.792095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb936fe-656c-450e-ad37-7ba74ae002b3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.798924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.799591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.799873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.800149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.800833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:44.801139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.802618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.816833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 194/381] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:44.818215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.863735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.864390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.864670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.864938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] PATH_INFO: `/v3/projects/182090e6549d4fc0b6e88a4c20692c62` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.866257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=182090e6549d4fc0b6e88a4c20692c62)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.867752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.869700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 188/382] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/projects/182090e6549d4fc0b6e88a4c20692c62 => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:44.875201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:44.879413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:44.939765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0c602-fb43-482d-8e4b-757cdf0d1284 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:44.979881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:44.980538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:44.980826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:44.981108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:44.983437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:44.985107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:44.991083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 195/383] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:44.993288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:45.076331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1c95c-6eaa-4144-ae1e-bba7c0540ae6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:45.099461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:45.128135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:45.138340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:45.139369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.139765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9e09-2735-4549-b0d6-db4f839f9373 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:45.140219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.140652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] PATH_INFO: `/v3/groups/8d4df964d3834c79adcc7a31ca2765e6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.155801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] RBAC: Authorizing `identity:get_group(group_id=8d4df964d3834c79adcc7a31ca2765e6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:45.157539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:45.159952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 189/384] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/groups/8d4df964d3834c79adcc7a31ca2765e6 => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:45.166161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:45.177695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:45.179503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.179889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.180267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.181547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:45.183131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:45.189802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 196/385] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:44 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:45.190859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:45.305633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f207c-759b-4d17-9572-1d12d16ba55f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:45.335527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd501553-0682-4649-8fa3-60004c21162b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:45.355201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:45.356313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.356689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.357070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/groups/6ef56ca69a9345e096ed83671e450f34/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.360294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, group_id=6ef56ca69a9345e096ed83671e450f34, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:45.362501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b711a25-4c95-4d68-b85a-96c53e67192a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:45.373844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:45.374500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.374793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.375197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.375997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] RBAC: Adding query filter params (group.id=8d4df964d3834c79adcc7a31ca2765e6, role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=182090e6549d4fc0b6e88a4c20692c62) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:45.376323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:45.378254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:45.383142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 197/386] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Aug 30 16:03:45 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/groups/6ef56ca69a9345e096ed83671e450f34/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:45.384765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fcb2d-8bcf-4f8a-bb34-cc1af38aea21 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.385056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fcb2d-8bcf-4f8a-bb34-cc1af38aea21 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.385388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fcb2d-8bcf-4f8a-bb34-cc1af38aea21 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.392751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 198/387] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:45.395093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:45.397750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 190/388] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:45 2022] GET /identity/v3/role_assignments?group.id=8d4df964d3834c79adcc7a31ca2765e6&scope.project.id=182090e6549d4fc0b6e88a4c20692c62&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:45.398040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:45.398316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:45.427611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:45.429053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:45.449491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:45.540655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 199/389] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:45.846455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:45.899605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:45.981426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ea6e-48d2-4c32-b77c-bd02db514070 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.021166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.021802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.022904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.023237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.037149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-299816d4-fece-46fa-a029-f34efd9d8305 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:46.043199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:46.044084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:46.044918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 191/390] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:46.050519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.068325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec10a-83e9-4d4f-b02e-f2a767ed8835 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.068633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec10a-83e9-4d4f-b02e-f2a767ed8835 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.069059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec10a-83e9-4d4f-b02e-f2a767ed8835 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.071139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 192/391] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:03:46.076713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.076993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.077269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.097114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:46.098804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:46.185433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 193/392] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:46.216088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e8214-8b12-49eb-8e9c-166933036a1a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.265702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.266315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.266591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.266862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.267554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:46.267858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:46.269236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:46.282441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 200/393] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:46.288228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.325080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:46.414357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad74a-d755-4015-9c0d-ca8512cc1a87 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.457481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.458128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.458699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.458989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.460322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:46.461778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:46.463397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 194/394] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:46 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:46.469046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.486891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:46.516239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.621820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255174e-5918-45f5-8bf2-a2823856774f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.643426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79039dae-4967-4e40-8860-9671047fa618 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.645295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:46.662249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.663176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.663658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.664145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.665721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:46.667526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:46.669679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 201/395] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:46 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:46.676279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.702073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.702707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.703002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.703280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.728746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:46.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:46.734475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:46.735285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 195/396] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:46.742907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:46.831494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:46.872730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fc3a7-0846-407c-a8fc-6229c6dc021a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.930149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9429-afbe-461f-b1c7-1ac096ce2e34 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:46.937352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.938027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.938313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.938591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40/groups/6ef56ca69a9345e096ed83671e450f34/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.945293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] RBAC: Authorizing `identity:create_grant(project_id=d257f8265ff0472286dbf1d886336b40, group_id=6ef56ca69a9345e096ed83671e450f34, role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:46.947243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:46.972363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 202/397] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Aug 30 16:03:46 2022] PUT /identity/v3/projects/d257f8265ff0472286dbf1d886336b40/groups/6ef56ca69a9345e096ed83671e450f34/roles/d34b130893c44c4697b28b2f332822a6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:03:46.989721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:46.990339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:46.991273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:46.991540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:46.992221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:46.992727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:46.994123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:47.003400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 196/398] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:47.008689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:47.127023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9811-7802-4a5d-9939-0cb995b50f6a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:47.164011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:47.164382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.164549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.164827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.165962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:47.167706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:47.169527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 203/399] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:47 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:47.174663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:47.203203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:47.300608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86daec-efd1-4584-9490-a6350f7ed9b0 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:47.337394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:47.338030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.338313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.338635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.339795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:47.341253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a2fe-66e3-494e-8f09-e7e9d660ddd2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:47.343346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 197/400] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:47 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:47.348997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:47.358893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:47.459605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619400-d3d4-43ed-b63f-726800f6445f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:47.496186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:47.496909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.497197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.497474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/groups/6ef56ca69a9345e096ed83671e450f34/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.499469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, group_id=6ef56ca69a9345e096ed83671e450f34, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:47.500920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f76d1-3e47-4cdb-aa0b-a3f3921ef8a9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:47.518210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 204/401] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Aug 30 16:03:47 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/groups/6ef56ca69a9345e096ed83671e450f34/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:47.930516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c7b5-1f7b-4078-a70b-0a501f516961 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.931079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c7b5-1f7b-4078-a70b-0a501f516961 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.931079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c7b5-1f7b-4078-a70b-0a501f516961 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.932536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 198/402] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:47.933921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf31f2-ffbf-4bcb-bef2-8e7fb024c313 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.934218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf31f2-ffbf-4bcb-bef2-8e7fb024c313 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.934494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf31f2-ffbf-4bcb-bef2-8e7fb024c313 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.936093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 205/403] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:47.938803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249468f-ade7-4620-b17e-8b49bb03f20f None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.939124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249468f-ade7-4620-b17e-8b49bb03f20f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.939394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249468f-ade7-4620-b17e-8b49bb03f20f None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.940890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 199/404] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:47.942114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.942399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.942670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.949265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b9-cbea-409a-8ae3-ff2afa04c4d8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:47.949535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b9-cbea-409a-8ae3-ff2afa04c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:47.949811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b9-cbea-409a-8ae3-ff2afa04c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:47.969769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bc8ba2b9-cbea-409a-8ae3-ff2afa04c4d8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:47.970459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:47.970958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bc8ba2b9-cbea-409a-8ae3-ff2afa04c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:47.972134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:48.040049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.051491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 200/405] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:03:48.051491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.051491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.051491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.056674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 206/406] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:48.068964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:48.070295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:48.083955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.140220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 201/407] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:48.460919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.474927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.579326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6e04-d32f-4437-a03b-38a114ce9ab3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.588695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e6d74-79ec-4e4f-b7a8-e21961830503 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.618000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.618624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.618902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.619195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.629933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:48.630446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.631896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.632401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.632868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:48.635452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:48.636361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:48.637540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 202/408] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:48.638192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.647733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:48.653497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:48.654571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:48.655485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:48.656289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:48.658879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 207/409] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:48.660883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.723427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.757217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c36-a3a6-4e8a-8e85-f69030ea4f58 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.771512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f8f-bdb1-41ba-835c-2e039b78f03d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.797087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.797777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.798237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.798424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.810793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:48.811662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.812483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.812905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.813331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.814154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:48.814608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:48.815574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:48.816712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 203/410] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:48.817844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.820065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:48.829788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 208/411] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:48.830944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.896294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.932912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b165-4ce0-43be-bdad-916bac805853 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.946140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d038-29d6-4ff9-a11c-df0e71e3fa48 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:48.965373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:48.970966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.971557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.971836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.972112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.972825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:48.973190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:48.974701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:48.987131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 204/412] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:48.989346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:48.989732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:48.990347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:48.990627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:48.991580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:48.992217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:48.992525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:48.993950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.003339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 209/413] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.004199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.104761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138742a9-56bf-4237-b4c3-80616e32782e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.118606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b76c3-4c21-498f-b894-f8566dc29f25 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.136629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.143461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.144372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.144925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.145459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.157762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.158400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.158682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.158961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.160217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.161763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.163426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 210/414] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.164270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.217882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.225425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.227242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.273390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd01c9-5d33-4293-8b9e-f8a5e9bca679 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.309627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.310261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.310546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.310820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] PATH_INFO: `/v3/groups/8d4df964d3834c79adcc7a31ca2765e6` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.312409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] RBAC: Authorizing `identity:get_group(group_id=8d4df964d3834c79adcc7a31ca2765e6)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.313546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.315626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 211/415] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/groups/8d4df964d3834c79adcc7a31ca2765e6 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.316623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.345233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 205/416] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:49.346593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.383025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.427619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b310362-6fac-43a6-8ab1-275689bb2ad9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.450478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.468356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d856-e09e-4ee2-9cae-cbfd7c1d8ecc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.473096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.473733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.474013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.474288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.476023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.477400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.483799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 212/417] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.483799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.512705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.513765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.514410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.514686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] PATH_INFO: `/v3/projects/182090e6549d4fc0b6e88a4c20692c62` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.516365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] RBAC: Authorizing `identity:get_project(project_id=182090e6549d4fc0b6e88a4c20692c62)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.518502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b861-6ae5-46f8-9709-4ded39848b2a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.521559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 206/418] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/projects/182090e6549d4fc0b6e88a4c20692c62 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.522959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa780c3-8bd3-4b89-93ff-0f71b99da4f9 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.523280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa780c3-8bd3-4b89-93ff-0f71b99da4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.523554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa780c3-8bd3-4b89-93ff-0f71b99da4f9 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.525054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 207/419] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:49.529428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa780c3-8bd3-4b89-93ff-0f71b99da4f9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.597919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe53e-1144-46b5-b70e-6eba551be77f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.630599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.636114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa780c3-8bd3-4b89-93ff-0f71b99da4f9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.636472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.637165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.637443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.637714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.638991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.640435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.646348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 213/420] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:49.646348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.676514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.677271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.677625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.677967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17/groups/6ef56ca69a9345e096ed83671e450f34/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.681163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88306b3abe9448cb02665940375ce17, group_id=6ef56ca69a9345e096ed83671e450f34, role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.682596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808eb04c-5e8c-42d9-a67c-c76aae529225 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.695243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 208/421] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Aug 30 16:03:49 2022] PUT /identity/v3/projects/a88306b3abe9448cb02665940375ce17/groups/6ef56ca69a9345e096ed83671e450f34/roles/d34b130893c44c4697b28b2f332822a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:49.696555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.696901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.697241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.717072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:49.717292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:49.719096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:49.770728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a408949-946d-477e-a6aa-e314f579eada None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.807017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 209/422] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:49.807017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:49.822833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:49.823643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.824033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.824396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] PATH_INFO: `/v3/projects/182090e6549d4fc0b6e88a4c20692c62/groups/8d4df964d3834c79adcc7a31ca2765e6/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.826460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=182090e6549d4fc0b6e88a4c20692c62, group_id=8d4df964d3834c79adcc7a31ca2765e6, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:49.828076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fd7b8-b751-4a92-b377-45eb61b2a4f7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:49.844629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 214/423] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Aug 30 16:03:49 2022] PUT /identity/v3/projects/182090e6549d4fc0b6e88a4c20692c62/groups/8d4df964d3834c79adcc7a31ca2765e6/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:03:49.851048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783170-ef86-429d-837d-3f5c7e213695 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.851048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783170-ef86-429d-837d-3f5c7e213695 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.851048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783170-ef86-429d-837d-3f5c7e213695 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.853311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 215/424] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:49.854746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:49.855055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:49.855333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:49.880949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:49.882398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:49.968355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c40e-b6bd-4c85-8759-a03d1fed6d2c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:49.971333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.036346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.037439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.038338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.038823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.042925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:50.044409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 216/425] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:50.044794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:50.046794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 210/426] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:49 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:50.060044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.087817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.140933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.211328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83645329-6dfb-40f2-8eca-65c73ce0eac4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.250989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.251660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.252469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.252810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.264546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:50.269400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:50.270298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:50.271148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:50.272212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 211/427] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:50.278173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.300194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65183d41-a106-4e47-91b8-74c2005706f2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.316167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.363620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.364475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.365115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.365396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.366187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=d257f8265ff0472286dbf1d886336b40) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:50.366496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:50.368625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:50.377270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 217/428] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:50.378481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.449247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1585a18-c31e-40ea-96fb-5c0370cfc4bd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.504064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d662-8503-4966-a0a2-21285584cc13 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.514163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.528366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.528985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.529268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.529542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.530225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:50.530528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:50.531950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:50.544081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.544731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.545007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.545278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.550856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 212/429] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:50.557601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.558198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:50.563487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:50.565706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:50.567703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 218/430] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:50.576290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.683205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.707905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c1e81-96bc-4569-a0a2-5788d86dc0d1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.710514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93240d-078f-4a80-a5c6-ecbabc1eec39 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.748586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.749320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.749673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.750015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.758008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.758628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.758905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.759197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.760315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:50.760623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:50.762383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:50.773881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 219/431] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:50.779946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:50.825259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.854617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:50.854617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:50.916611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9f3c-aac7-4fb0-8624-fb263a1cfba0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:50.947573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:50.954078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:50.954851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:50.955170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:50.955442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:50.976109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 213/432] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:50.982147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.032844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.034321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.065734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:51.101621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eaa7f-10c0-4264-b83d-e5b72388190e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.142224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.142874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.143201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.143475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] PATH_INFO: `/v3/projects/d257f8265ff0472286dbf1d886336b40` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.144708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] RBAC: Authorizing `identity:get_project(project_id=d257f8265ff0472286dbf1d886336b40)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.146184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.148917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 214/433] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/projects/d257f8265ff0472286dbf1d886336b40 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:51.154764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.164991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 220/434] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:51.173181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.217098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:51.280028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96a74-106e-41b2-b665-496d36b2a895 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.301373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657a656-baf4-4bec-8841-a570f9ac130b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.322411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.323226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.323794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.324081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.325219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.327118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.329294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 215/435] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:51 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:51.335826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.337616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:51.347014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.347663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.347945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.348215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.349434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.351242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.353280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 221/436] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:51 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:51.358694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.469254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c93d-61fb-4624-aadd-1ca434c3f2d4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.487372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85983-46c8-4106-8f02-5598e942848f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.489284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:51.518060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.519089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.519502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.519891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.520636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=d257f8265ff0472286dbf1d886336b40) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:51.520943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.523836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.527658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.528417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.528801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.529170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.530408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.530587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 216/437] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:51 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=d257f8265ff0472286dbf1d886336b40&role.id=d34b130893c44c4697b28b2f332822a6 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:51.532088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fec27-efda-4eb8-a3c3-ee2456de731e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.534004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 222/438] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:51 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:51.539719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:51.652532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c92739-53e3-45bf-aac8-fb2e25dd50d3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:51.691633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:51.692239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.692522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.692795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.693528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=e635c23c0fae471ea6d0f2de2d71799f, scope.project.id=a88306b3abe9448cb02665940375ce17) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:51.694365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:51.696015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc999eb-b202-46e7-bb89-3874b9d25fd5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:51.702676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 217/439] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:51 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=e635c23c0fae471ea6d0f2de2d71799f => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:51.922668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db888a-129d-413e-9799-d388b899b0d5 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.923063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db888a-129d-413e-9799-d388b899b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.923319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db888a-129d-413e-9799-d388b899b0d5 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.924913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 223/440] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:51.930941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7043d1-eb10-45ca-86d8-ac6fd4e6ade3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:51.931260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7043d1-eb10-45ca-86d8-ac6fd4e6ade3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:51.931540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7043d1-eb10-45ca-86d8-ac6fd4e6ade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:51.951073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6e7043d1-eb10-45ca-86d8-ac6fd4e6ade3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:51.952278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6e7043d1-eb10-45ca-86d8-ac6fd4e6ade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:51.990490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.027609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 218/441] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:52.049320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cbfa-1416-489b-9092-12b14fa4c091 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.049602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cbfa-1416-489b-9092-12b14fa4c091 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.049905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cbfa-1416-489b-9092-12b14fa4c091 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.051510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 224/442] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:52.057033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.057325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.057597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.075850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:52.077027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:52.144667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 219/443] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:52.299552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3cbfa-1416-489b-9092-12b14fa4c091 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.361479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.400914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3cbfa-1416-489b-9092-12b14fa4c091 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.415780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.435900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.436526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.436804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.437074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.448619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:52.453395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:52.454319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:52.455164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 225/444] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:52.460173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.516256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d810d3-d967-4e06-b9f9-e6c21097d107 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.517737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.551140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.551695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.551975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.552262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.559075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d990-4e2f-4fbb-9ca9-7e148d426e0d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.562314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:52.567127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:52.568070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:52.569393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 220/445] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:03:52.574381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.584365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.596064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.596674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.596956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.597232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.597893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:52.598205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:52.599631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:52.607537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 226/446] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:52.613267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.674186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c292-bcf3-464a-925d-02791a9e9a31 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.710195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e8f4d-0c68-490a-90a5-7d98cf073dcc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.710668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.711298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.711626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.711842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.712505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:52.712799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:52.714162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:52.722286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 221/447] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:52.728504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.745295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.745913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.746186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.746457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.753917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.800646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.813855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:52.815285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:52.828849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980307-51e9-4204-8827-9e44183de9c7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:52.863456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:52.864051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:52.864327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:52.864594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:52.918641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 227/448] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:52.924458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:52.934695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:52.936188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:52.961079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.008051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.023087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056ea3-3e29-42ce-9690-389dd3d42ec5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.039125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 222/449] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:53.044631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:53.057358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.057983 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.058259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.058535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] PATH_INFO: `/v3/projects/a88306b3abe9448cb02665940375ce17` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.059666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] RBAC: Authorizing `identity:get_project(project_id=a88306b3abe9448cb02665940375ce17)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.061109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.062692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 228/450] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:52 2022] GET /identity/v3/projects/a88306b3abe9448cb02665940375ce17 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:53.068089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:53.143635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077c29e-16cb-411f-b797-789cd99a829b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.167917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.172392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97713-f382-4082-ad01-ca236b921f7a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.179321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.179997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.180271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.180541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] PATH_INFO: `/v3/projects/182090e6549d4fc0b6e88a4c20692c62` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.181688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] RBAC: Authorizing `identity:get_project(project_id=182090e6549d4fc0b6e88a4c20692c62)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.183149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.184757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 223/451] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:03:53 2022] GET /identity/v3/projects/182090e6549d4fc0b6e88a4c20692c62 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:53.190073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:53.206218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.206897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.207204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.207480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] PATH_INFO: `/v3/groups/6ef56ca69a9345e096ed83671e450f34` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.208588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] RBAC: Authorizing `identity:get_group(group_id=6ef56ca69a9345e096ed83671e450f34)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.210224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.211814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 229/452] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:53 2022] GET /identity/v3/groups/6ef56ca69a9345e096ed83671e450f34 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:53.217460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:53.241061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.292184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611173eb-1b1b-46a6-8cf2-a882f54783a7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.315648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc956ba-acf9-487a-8f2d-de4355297884 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.325745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.326299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.326568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.326840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] PATH_INFO: `/v3/groups/8d4df964d3834c79adcc7a31ca2765e6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.327966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] RBAC: Authorizing `identity:get_group(group_id=8d4df964d3834c79adcc7a31ca2765e6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.329387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.330937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 224/453] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Aug 30 16:03:53 2022] GET /identity/v3/groups/8d4df964d3834c79adcc7a31ca2765e6 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:53.336820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:53.350740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.351371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.351652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.351927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.352649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] RBAC: Adding query filter params (group.id=6ef56ca69a9345e096ed83671e450f34, role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=a88306b3abe9448cb02665940375ce17) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:53.352957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.354412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00094411-8bce-468a-af2a-b740536b9e61 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.360065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 230/454] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:53 2022] GET /identity/v3/role_assignments?group.id=6ef56ca69a9345e096ed83671e450f34&scope.project.id=a88306b3abe9448cb02665940375ce17&role.id=d34b130893c44c4697b28b2f332822a6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:53.403931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.446872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530328d-3fca-48ef-8c18-ef950fcacbab None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:53.482941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:53.483581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:53.483865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:53.484141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:53.484887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] RBAC: Adding query filter params (group.id=8d4df964d3834c79adcc7a31ca2765e6, role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=182090e6549d4fc0b6e88a4c20692c62) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:53.485213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:53.486665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed85974-b695-49fa-8d40-cd28dff4e3ee None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:53.493231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 225/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Aug 30 16:03:53 2022] GET /identity/v3/role_assignments?group.id=8d4df964d3834c79adcc7a31ca2765e6&scope.project.id=182090e6549d4fc0b6e88a4c20692c62&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:55.946503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af8e-f299-45a6-9cba-a5ab091d6f56 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:55.947027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af8e-f299-45a6-9cba-a5ab091d6f56 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:55.947103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af8e-f299-45a6-9cba-a5ab091d6f56 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:55.948660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 231/456] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:55.953782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfad520-1e32-471e-8eea-0ac0347eee2b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:55.954191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfad520-1e32-471e-8eea-0ac0347eee2b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:55.954364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfad520-1e32-471e-8eea-0ac0347eee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:55.978708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0bfad520-1e32-471e-8eea-0ac0347eee2b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:55.979945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0bfad520-1e32-471e-8eea-0ac0347eee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:56.072264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 226/457] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:56.086886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddda43-d1f3-4b1f-b871-deb0d5d46b64 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.087211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddda43-d1f3-4b1f-b871-deb0d5d46b64 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.087463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddda43-d1f3-4b1f-b871-deb0d5d46b64 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.089036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 232/458] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:56.093950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.094185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.094465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.123995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:56.125202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:56.184912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4146f3-6d24-4597-ad30-372410b19e76 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.185265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4146f3-6d24-4597-ad30-372410b19e76 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.185465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4146f3-6d24-4597-ad30-372410b19e76 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.187050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 233/459] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:56.191751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:56.200638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.200917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.201197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.215858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 227/460] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:56.235975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:56.237208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:56.349377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 234/461] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:56.462930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:56.526868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:56.567648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:56.576172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010566b-453c-49a5-bb3d-6d90a90b27d2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:56.654140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:56.654697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.655008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.655279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.666235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:56.667745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6c2f8a4d-e2e9-4938-9c5d-f353b7a65676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:03:56.682610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:56.683603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:03:56.684476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:03:56.684476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:56.684476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:56.684476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 228/462] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:56.685192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739da9-19aa-482d-a924-c4daa02d4d78 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.687380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739da9-19aa-482d-a924-c4daa02d4d78 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.687876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739da9-19aa-482d-a924-c4daa02d4d78 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.689591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 229/463] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:56.690342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c247d-48b6-47c5-ad92-3532698aa046 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:56.691635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739da9-19aa-482d-a924-c4daa02d4d78 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:56.731621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:56.732281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.732556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.732830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.735972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:56.745181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:56.746882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0da86c3c-fcbe-4542-a522-36673f21f97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:03:56.764454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:56.765333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:03:56.766264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:03:56.766264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:56.766264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:56.768056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 235/464] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:56.769571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.769860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.770137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.789141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:56.790338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:56.808236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739da9-19aa-482d-a924-c4daa02d4d78 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:56.844117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:56.844731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:56.845015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:56.845288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:56.845932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:56.846239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:56.847690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:56.860495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:56.865668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 230/465] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:56.867292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:56.868064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 236/466] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:56.869117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:56.972714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:56.981250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310fc0-00ca-4eb2-afb9-e830676e3a1c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:56.985043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241dec2-10f1-49c3-88b1-96b7d4f03296 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.018619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.019248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.019529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.019803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.025141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.026017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.026500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.026973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.027886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:57.028406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.030014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.030956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.032573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:03:57.048854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:57.050106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:03:57.051086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:03:57.051086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:57.051086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:57.051086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 231/467] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:57.051086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.051985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 237/468] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:57.057482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.134710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:57.158060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393c92-e577-4a33-a5cb-61a934adf8cd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.185204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b24a-64d3-4e20-955f-8b8122e6ea2e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.192968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.193615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.193920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.194298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.195166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.196611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.219545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 232/469] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:57 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:57.220179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.224769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:57.251623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.252247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.252525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.252792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.254610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:57.254851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.256308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.277287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 238/470] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:57.278544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.369957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e695ab-c141-4f9e-b91c-5f7df0713cf9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.411170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.412145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.412407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630cc1a-8034-4daf-a189-b1d9956afd04 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.413730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.414214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.414886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.416633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.436108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:57.446457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 233/471] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:57 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:57.447713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.458224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.458518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.458847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.459163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.472236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.473759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-7732ef95-6e07-48d7-a7fc-38d5e5002f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:03:57.493106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:57.494241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:03:57.495306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:03:57.495306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:03:57.495306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:57.496873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 239/472] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:57.498346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080724f-02f1-4887-b89a-becc6fcfc94e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.498635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080724f-02f1-4887-b89a-becc6fcfc94e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.499051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080724f-02f1-4887-b89a-becc6fcfc94e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.500181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 240/473] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:57.504169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080724f-02f1-4887-b89a-becc6fcfc94e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.542524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:57.605844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840993-60f0-4649-a129-76e32fe88c39 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.633160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080724f-02f1-4887-b89a-becc6fcfc94e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.648388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.649007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.649292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.649569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.650348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.652094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570b60-00b9-49f7-a0c6-6662968f09ee None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.679862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 234/474] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:57 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:57.680897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.681193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.681470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.688263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.688460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.688689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.688977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.689635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:57.689945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.691438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.710651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:57.711833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 241/475] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:03:57.712034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:57.719002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:57.766197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:57.807503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 235/476] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:57.864558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d88f-1548-4f40-82c7-b759af3df7a9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:57.901813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:57.902559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:57.902968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:57.903336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:57.904044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:57.905556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:57.929271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 242/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:03:57 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:03:58.122388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:58.171638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:58.227579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51201a-b3da-4651-8b4a-0973a7a4c7f4 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:58.262457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:58.263167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:58.263456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:58.263733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:58.264409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:58.265790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:58.275907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.sql.core [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 16:03:58.275907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 16:03:58.275907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [parameters: {'id': '82904575464a4377b0ed67121b7e4fd3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 16:03:58.275907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application result.read() Aug 30 16:03:58.293831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:03:58.294765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application yield resource Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise self.value Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application session.commit() Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 16:03:58.295727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self.session.flush() Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application compat.raise_( Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:03:58.296602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:03:58.297466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application result.read() Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:03:58.298303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [parameters: {'id': '82904575464a4377b0ed67121b7e4fd3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:58.300545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 16:03:58.302678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:03:58.311798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 236/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Aug 30 16:03:58 2022] POST /identity/v3/roles => generated 144 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:58.311940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:58.397756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:58.429309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8c48-5d41-4066-aeec-e7ed786fcbe5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:58.470504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:58.471170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:58.471450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:58.471721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:58.490555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4ce5eb90-6995-4307-9739-e297a7cdb6c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:03:58.496078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:03:58.496966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:03:58.497769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 243/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:03:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:03:58.503067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:03:58.668243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38fe0d-b988-4a0b-82aa-8ed035a5dd4e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:03:58.695420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:58.728008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:03:58.728627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:58.728912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:58.729186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:58.729867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:03:58.730174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:03:58.731584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed8f75-25cf-4a63-a2ac-c82646e8e0b1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:03:58.740650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 237/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:03:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:03:59.580743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec7d4-b793-42cb-bc22-4d7c9df593b6 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:59.581619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec7d4-b793-42cb-bc22-4d7c9df593b6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:59.582036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec7d4-b793-42cb-bc22-4d7c9df593b6 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:59.583529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 244/481] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:59.589457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd05d2-8170-4229-8149-806c4dea42e3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:59.589881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd05d2-8170-4229-8149-806c4dea42e3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:59.590249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd05d2-8170-4229-8149-806c4dea42e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:59.611009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-55dd05d2-8170-4229-8149-806c4dea42e3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:59.612220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-55dd05d2-8170-4229-8149-806c4dea42e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:59.689818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 238/482] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:59.726781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bdbc7-8705-466f-9b1c-5bd5c0bb6d43 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:59.727129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bdbc7-8705-466f-9b1c-5bd5c0bb6d43 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:59.727352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bdbc7-8705-466f-9b1c-5bd5c0bb6d43 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:59.728900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 245/483] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:03:59.734383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:03:59.734678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:03:59.734961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:03:59.755537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:03:59.756785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:03:59.843002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 239/484] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:00.003915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bdbc7-8705-466f-9b1c-5bd5c0bb6d43 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.132727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bdbc7-8705-466f-9b1c-5bd5c0bb6d43 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.180729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.181420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.181706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.181979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.198518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:00.203514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:00.204382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:00.205161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 246/485] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:00.212474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.222269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.239310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.263269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.358124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951bc6-f28b-4b36-b0b0-fec2852983ca None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.362374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065ca4-c4d5-4495-9f9e-100906e89fb9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.394071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.394621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.394904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.395222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.406724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.407467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:00.407587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.407748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.408024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.408696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:00.409001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:00.410379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3b6b4768-aa05-4775-9aeb-90a99f442259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:00.413621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:00.414535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:00.415352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:00.419214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 247/487] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:00.419401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 240/487] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:00.420586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc11-3bf1-47ab-bc0c-9a46725febaa None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.420932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc11-3bf1-47ab-bc0c-9a46725febaa None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.421211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc11-3bf1-47ab-bc0c-9a46725febaa None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.422692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 248/488] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:00.425769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.427859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceafc11-3bf1-47ab-bc0c-9a46725febaa None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.500127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.547922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceafc11-3bf1-47ab-bc0c-9a46725febaa None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.552292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.560522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c622-3091-416c-b465-0dbd46f2c06e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.596423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.597134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.597289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.597716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.597716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.598116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.598116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.598476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.598924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:00.599261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:00.601356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cedeb-69db-4abf-add9-939e1f8f94aa None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:00.608662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:00.610090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:00.610855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 241/489] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:00.611967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.612250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.612526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-05455814-e851-42ff-ae27-9dff22067930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:00.625705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:00.628548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 249/490] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9025a3-667c-49d8-8319-e586d50158df None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9025a3-667c-49d8-8319-e586d50158df None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9025a3-667c-49d8-8319-e586d50158df None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 250/491] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:00.635399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9025a3-667c-49d8-8319-e586d50158df None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.636558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:00.636909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:00.708677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 242/492] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:00.710020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.748895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9025a3-667c-49d8-8319-e586d50158df None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.767458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.786632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.787314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.788142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.788474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.800234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:00.801822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-97eda706-aa45-4232-8f59-8e1ec6ab6de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:00.817096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:00.818036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:00.819428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:00.819428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:00.819428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:00.819428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 251/493] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:00.820773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.820773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.821067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.833080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:00.842281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:00.843563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:00.858812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a12d-4b12-494d-9ac8-1e2c1004e942 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:00.897856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:00.898471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:00.898755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:00.899127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:00.899780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:00.900141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:00.901527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:00.914053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 243/494] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:00.915055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:00.947207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 252/495] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:00.949636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.055338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6f734-bc4c-43ca-9934-64aadb0e1a99 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.090845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.091483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.091765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.092039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.092141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.092680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:01.092983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.094411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.097291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4925-1a50-4792-8683-c4fb27d50c80 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.107820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 244/496] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:01.108804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.117983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.148304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.149226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.149655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.150083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.160184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.162359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:01.181278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:01.182382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:01.183517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:01.186084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 253/497] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:01.187103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.227304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9941c4e-fade-46d7-b638-322121337327 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.271238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.271870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.272205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.272589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.283191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:01.288490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:01.291221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 245/498] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:01.292242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.313500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136aaef-3e9e-43d6-9ab5-d3ae044d5e3d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.348346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.348976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.349257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.349538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.357699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.359218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.365279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:01.371585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:01.372528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 254/499] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:01.373445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.397709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.404768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc75e0f-ec0c-490c-8831-4df8d7e6e91c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.438170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.438768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.439080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.439357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.440078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:01.440383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.441818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.476863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a46a-5d06-4d96-b227-8521f5cef078 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.478403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 246/500] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:01.479250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.511544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.512190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.512466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.512733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.523063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:01.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:01.529731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:01.530538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 255/501] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:01.531223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.581992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4136-dba6-40ed-af35-11b19c7fc791 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.605757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.609466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.618047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.618648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.618924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.619225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.619884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:01.620182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.621546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62553b-4703-44e0-b85d-79846e33bd6a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.629194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 247/502] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:01.630321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876add3-b506-443b-8337-e6bacf1ab8fa None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.630509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89442-14e9-4ad9-abb2-331418dcb42d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.630610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876add3-b506-443b-8337-e6bacf1ab8fa None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.630863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876add3-b506-443b-8337-e6bacf1ab8fa None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.633134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 248/503] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:01.635799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876add3-b506-443b-8337-e6bacf1ab8fa None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.666071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.666671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.666947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.667250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.667972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:01.668279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.669711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.705270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 256/504] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:01.706083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.738916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876add3-b506-443b-8337-e6bacf1ab8fa None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.773402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.774010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.774293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.774568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.805492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bf9f-eca8-428b-92a5-784493bf0139 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.828427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.838920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.839493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.840045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.840217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.840857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:01.841170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.842556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.842851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:01.844304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a3177-b606-4348-9ed9-0abfe1b559a5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:01.847756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:01.851662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 257/505] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:01.852873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:01.943950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 249/506] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:01.945225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.945514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.945792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:01.958248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52cbd-6c76-46f3-b4b2-46160a73f56c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:01.963355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:01.964872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:01.991871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:01.992486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:01.992765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:01.993031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.003131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.004577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:02.018285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.019271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:02.020121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:02.020121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.020121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:02.020121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 258/507] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.020345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.034394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 250/508] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:02.035282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.053112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.092118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.143520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e1cd9-84cb-4616-acad-5240a047e3d0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.143966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07534f-3f0f-4ab2-8b14-c3e5bfec248a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.179036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.179650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.179926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.180195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.181890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.182843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.183231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.183506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.191111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.192571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:02.207804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.208722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:02.209624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:02.209624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.209624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:02.209624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 251/509] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.210395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.261986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.263516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.280949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.317438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65605d-d9cc-4bd4-b70c-cdd30351b929 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.318352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.351049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.351599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.351881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.352203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.362431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.364177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.368312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 259/510] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:02.369316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:02.378898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.380004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:02.380865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:02.380865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.380865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:02.380865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 252/511] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.380865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.472890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e4a9-6402-4877-ad47-f999b10e40d3 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.479974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e48d9-adb2-4d11-871e-fe93e2853cda None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.499491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.506247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.507085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.507226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.507502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.508130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:02.508429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.509798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.514390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.515037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.515323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.515596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.516232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:02.516535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.517901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.520710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 260/512] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:02.521479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.534309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 253/513] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:02.534309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.541268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.626844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534b20-5558-432c-95a5-ca72db90c654 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.628285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e58fc4-6e32-4eb5-b136-8c1dd4f2c9f5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.659851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.660467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.660745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.661011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.662478 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.663846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.664127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.664402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.672683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.674188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.674553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.676028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:02.688656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.689569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:02.690694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:02.690694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.690694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:02.690694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 261/514] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:02.691088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.691895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:02.693248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:02.693248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:02.693248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:02.693525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.693629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 254/515] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.693629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.725221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.755278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.793522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7cc0-0ec7-483e-b6f6-5f6203241621 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.794247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa620f9-9459-4798-8a7e-aa1c03eb5aff None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.825894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.826580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.826864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.827171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.827807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:02.828110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.828582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.829204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.829488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.829575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.829765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.837338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.838838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.842819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 262/516] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:02.843671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:02.852220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:02.853128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:02.854030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 255/517] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:02.854603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:02.944502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b8c8-bcb3-4d01-81f6-850d6f220b81 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.948910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.958724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d97d-c1f0-4503-9030-fad0eaac0cfb None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:02.969789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:02.981299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.981919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.982192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.982466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.989605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.991221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:02.993249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:02.993850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:02.994161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:02.994440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:02.995108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:02.995419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:02.996795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:03.002428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:03.003465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 263/518] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:03.004369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.009707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 256/519] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:03.010889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.103348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd548f-a1a0-4b02-8bd0-3ccab89ede35 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.108805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba400-9f72-4d7d-8a7f-9e79dc54f0c8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.137233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.137832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.138112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.138378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.139056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:03.139357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.140722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.142905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.143645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.143934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.144209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.150955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.152106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 264/520] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:03.152436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.152902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:03.164811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:03.165852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:03.166704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 257/521] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:03.167212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.185464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.204268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.271048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96b04-3d86-4320-8d83-126204c97be8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.297864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b43df-c819-450a-889e-86138bec49d1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.315610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.316220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.316500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.316773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.317505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:03.317810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.319959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.339859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 265/522] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:03.340640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.343536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.344196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.344427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.344698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.345421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:03.345721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.347180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.365244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 258/523] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:03.366254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.444060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64f0c-ea18-4a89-9219-2b757607d5ba None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.444764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.445575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.477763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b0ec5-e0e7-490c-a08a-c2c61651e58b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.479668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.480271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.480552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.480825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.481461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.482903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.503136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 266/524] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:04:03 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:03.511508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.512001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.512149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.512482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.512689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.520296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.522055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:03.538508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:03.539607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 259/525] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:03.541351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.639804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7099-f0db-46ed-8f63-5d2780a33b74 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.663661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145976-6bea-4951-a233-38a399c5bd34 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.681489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.682528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.682810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.683114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.684097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:03.684414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.685864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.698020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.705157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.705942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.706222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.706490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.707747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 267/526] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:03.708586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.731377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.783589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.786395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.819296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c07fc-22d7-472b-8f0e-1369b521e33f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:03.854787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:03.855435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:03.855718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:03.855991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:03.906957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 260/527] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:03.906957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:03.935061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:03.936537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:03.938554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:03.955176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.020046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabd5b8-38ce-4ab7-ab55-691c985fa269 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.051028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 268/528] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:04.051028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.060386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.060998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.061277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.061549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.062246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:04.062549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.064005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.083893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 261/529] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:04.084785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.160471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1677d-9af9-4e65-86fb-e370581e9628 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.180725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.185292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.198855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031e0f-706d-4227-b8b3-88a4d27abdd7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.199970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.200568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.200843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.201113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.201824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:04.202132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.203614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.209126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 269/530] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:04.210590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.264087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.265634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.266344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.266781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.281754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.284128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:04.306449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:04.307684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:04.308747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:04.308747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:04.308747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:04.310581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 262/531] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:04.311940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.335998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef589eb-099a-49fd-bb0e-81651552ef48 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.377659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.378563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.379013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.379433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.393491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.395227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:04.413993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:04.415294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:04.416249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:04.416249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:04.416249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:04.418129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 270/532] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:04.419135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.442961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee26f-dc93-439b-b69e-8e0bf107bcbc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.461609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.483490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.484354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.484748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.485121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.485950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=25211db01b88403c8e4c9479ea9333c3) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:04.486362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.488048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.499022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 263/533] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/role_assignments?user.id=25211db01b88403c8e4c9479ea9333c3&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:04.499022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.516972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.555833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821348a-2fc6-42ef-a97a-b5bd605b52e8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.595992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.596805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.597092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.597363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.598016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:04.598318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.599741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.615112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 271/534] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:04.620834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.733671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a8e20-3c1a-45d4-88cb-e7fabcfccabc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.747390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.773534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.774171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.774449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.774717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.789834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.793973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:04.818402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:04.819593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:04.820464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 272/535] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:04.825364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.845223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f50d-ba93-46f7-9201-6690237b402c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:04.884119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:04.884734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:04.885017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:04.885290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:04.885931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:04.886241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:04.887699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:04.901326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 264/536] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:04.906614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:04.977326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:04.988658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119177-c218-4239-b240-14c2a1e185b5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:05.016351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786c7f-0aa5-4297-8806-ed82cb113390 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:05.025935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:05.026554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.026839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.027152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.027852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:05.028164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:05.029720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:05.043147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 273/537] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:05.054716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:05.055219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:05.055806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.056132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.056412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.063775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:05.065237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:05.077128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:05.078084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:05.079327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 265/538] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:05.084094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:05.095338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.213626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd8e0-9004-4b00-a99b-28617ea65aeb None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:05.264179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c380-e4ee-4483-b58c-203a836addf8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:05.298894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.304959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:05.305698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.306081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.306477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.307530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=dc6e7b66794e4416ba15562e47e9888f) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:05.307960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:05.309712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:05.310322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:05.311128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.311552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.311979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.312796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:05.313227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:05.314847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcad6d-60c9-46ed-b1e1-a3a60739d298 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:05.326002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 274/539] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:05 2022] GET /identity/v3/role_assignments?user.id=dc6e7b66794e4416ba15562e47e9888f&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:05.328762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 266/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:05.335087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:05.431736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.473405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78d15-330f-4925-bb7e-bcab6a7a7535 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:05.522828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:05.523475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.523756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.524064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.524774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=183c8b4ac78f42678d68527a0c6e09ba) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:05.525086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:05.526629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b555197-bb56-4582-b7c7-731bac748140 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:05.535375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 275/541] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:05 2022] GET /identity/v3/role_assignments?user.id=183c8b4ac78f42678d68527a0c6e09ba&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:05.547822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9de74-64b3-4036-99c1-0128eaa59a1e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.548136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9de74-64b3-4036-99c1-0128eaa59a1e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.548386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9de74-64b3-4036-99c1-0128eaa59a1e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.549727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 267/542] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:05.556002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:05.556314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:05.556557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:05.577218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:05.578428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:05.655867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 276/543] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:05.933757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9de74-64b3-4036-99c1-0128eaa59a1e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:06.056237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9de74-64b3-4036-99c1-0128eaa59a1e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:06.091785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:06.092430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.092709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.092980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.104251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:06.109099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:06.109977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:06.110783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 268/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:06.116886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:06.233612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:06.276616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bcfc9-5343-48fd-8fa0-ec422f1d55d7 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:06.325561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:06.326172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.326446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.326713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.327417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:06.327717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:06.329083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:06.340467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 277/545] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:06.345846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:06.409735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:06.465694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028d19-7880-4915-a1d8-22ba2adec03e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:06.500751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:06.501302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.501583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.501859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.513192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:06.514673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-60806fd2-c1ae-41f5-af6e-83dcda6a215b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:06.528964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:06.529877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:06.530732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:06.530732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:06.530732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:06.530732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 269/546] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:06.535756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:06.695124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957f89a-1dde-418f-8efe-a228829f26e2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:06.697768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef970-eb45-4ce4-8529-29387816deb5 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.698062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef970-eb45-4ce4-8529-29387816deb5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.698337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef970-eb45-4ce4-8529-29387816deb5 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.699958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 270/547] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:06.707003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c073d-0a8c-465c-93a7-b3c2d135de81 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.707003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c073d-0a8c-465c-93a7-b3c2d135de81 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.707003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c073d-0a8c-465c-93a7-b3c2d135de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.724532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e39c073d-0a8c-465c-93a7-b3c2d135de81 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:06.726253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e39c073d-0a8c-465c-93a7-b3c2d135de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:06.749056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:06.749764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.750113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.750452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.751253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:06.751573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:06.753046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320c2a-e65f-48ab-b2ad-c33fa30bf53a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:06.755017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:06.769493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 278/548] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:06.770758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d4c01-701b-4911-8329-23298c8cb988 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.771260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d4c01-701b-4911-8329-23298c8cb988 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.771624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d4c01-701b-4911-8329-23298c8cb988 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.773813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 279/549] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:06.775879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d4c01-701b-4911-8329-23298c8cb988 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:06.827245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 271/550] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:04:06.829691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.830126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.830548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.862808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:06.864526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:06.916924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:06.935906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d4c01-701b-4911-8329-23298c8cb988 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:06.973729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:06.974562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:06.974848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:06.975248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:06.983684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:06.986253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:07.002397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:07.003575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:07.004503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 280/551] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:07.009957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.036625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 272/552] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:07.072497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.121999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417ef29-6e19-4154-93e5-16712e502241 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.157637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.158496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.159021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.159495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.160423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:07.160928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:07.162566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.181847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 281/553] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:07.188049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.259691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.303054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306580-d49f-4c04-86cd-00447fd9ae55 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.342926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.343720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.344157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.344524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.391387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.406690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25faac-0aba-4a7e-9dd2-1b67475af8a5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.421170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.438305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:07.439921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.446719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.447649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.448162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.448657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.459904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:07.465415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:07.466344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:07.467213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:07.469844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 282/554] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:07.470928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.547160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 273/555] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:07.548019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.578874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdda6b-f5c0-4833-98bd-373847260580 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.615025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.615380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.616145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.616576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.617062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.627844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:07.633639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:07.634633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:07.635511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:07.638124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 283/556] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:07.639241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.663130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a429-5749-483c-a5d2-9cd190046c10 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.673898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.705548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.706187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.706472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.706752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.707543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:07.707914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:07.710089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.720152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 274/557] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:07.721001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.758444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbe8ed-5e41-416e-b3e4-e6cf02684e4f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.797331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.798418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.798903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.799849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.811860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:07.813714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.831402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a730f-9d1a-440c-8d52-7cc1aaf110df None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:07.837529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:07.838513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:07.839460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:07.839460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:07.839460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:07.841782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 284/558] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:07.842753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.872917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.889195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:07.889830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:07.890114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:07.890391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:07.891085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:07.891395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:07.892768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:07.901130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 275/559] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:07.901929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:07.941813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:07.965480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85adda-1f09-48cf-8906-e2ea2a7c54e7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.000112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.000741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.001021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.001290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.008468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc510-ab44-4056-807e-a56c9164cc59 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.012686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.014147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-cfeec3b5-1da5-4b54-86cc-f4accb4896a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:08.027825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.028807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:08.029701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:08.029701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:08.029701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:08.029701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 285/560] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.030056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb93cf-6ecf-44b9-a13d-10a01a29ceb0 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.030302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb93cf-6ecf-44b9-a13d-10a01a29ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.030596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb93cf-6ecf-44b9-a13d-10a01a29ceb0 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.031801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 286/561] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:08.032477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb93cf-6ecf-44b9-a13d-10a01a29ceb0 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.047964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.048510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.048800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.049079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.049730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:08.050037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.051462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e99f-0f47-48ae-896a-37873640979c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 276/562] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51db96-a2d0-4529-9faf-2a7f65e44bf7 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51db96-a2d0-4529-9faf-2a7f65e44bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51db96-a2d0-4529-9faf-2a7f65e44bf7 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 277/563] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:08.063348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51db96-a2d0-4529-9faf-2a7f65e44bf7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.114928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.137243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb93cf-6ecf-44b9-a13d-10a01a29ceb0 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.170826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.171484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.171768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.172042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.173157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51db96-a2d0-4529-9faf-2a7f65e44bf7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.174776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.183825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.185288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3c9b2538-f47c-41a3-bb31-4d22958f5e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:08.199977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.200905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:08.201781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:08.201781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:08.201781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:08.201781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 287/564] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.202678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9adbc9-0be2-41fe-b85e-a472dc4d1b28 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.202968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9adbc9-0be2-41fe-b85e-a472dc4d1b28 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.203269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9adbc9-0be2-41fe-b85e-a472dc4d1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.211021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.212444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.212727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.213002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.213656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:08.213961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.215353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.221340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bb9adbc9-0be2-41fe-b85e-a472dc4d1b28 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:08.222527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bb9adbc9-0be2-41fe-b85e-a472dc4d1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:08.227335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 278/565] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:08.228057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.293648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 288/566] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:08.293648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.293648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.293648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.320954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:08.322668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:08.328259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6423f-18e1-4b1b-91ca-356bbd5b1b89 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.329774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.364436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.365061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.365343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.365618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.372848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.374314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:08.386139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.387052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:08.387973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 279/567] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.388453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.398346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 289/568] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:08.407259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.456323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.518301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216bf3b-c96f-4849-b742-fc08e622064d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.523706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318d54b-0a4e-47a2-a4b4-3140af1cf92a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.561555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.562187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.562471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.562800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.565241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.566327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.566609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.566888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.567557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:08.567858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.569458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.569923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.571446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.588362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 280/569] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:08.588362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:08.588639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.589701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 290/570] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.590863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.617433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.695307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57781121-00c4-4fc1-ab9f-ba31318527b0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.695537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346fb1-041b-41b5-ba55-e201765990c3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.704771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.730190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.730792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.731104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.731377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.731608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.732060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:08.732242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.732378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.732512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.732789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.733787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.743375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:08.745391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 281/571] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:08.746167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:08.748760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.749738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:08.750592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 291/572] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.751470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.828881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.848373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decb84-56e7-48f8-9535-ea4486728f4d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.850559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffc85-0b67-4561-919a-9c5b317079ff None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:08.884214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.884734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:08.885093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.885358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:08.885454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.885627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.885719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:08.885906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:08.886342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:08.886649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.888116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.893190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:08.894620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:08.904903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 292/573] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:08.905699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:08.905805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:08.906677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:08.907671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 282/574] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:08.908241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:08.937591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.009191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934965-fc91-4bc8-8e20-10874a54c549 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.012302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1ec6-b357-471c-bea8-a2571de4d471 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.042803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.043430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.043708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.043976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.044687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=72c7ab7c53954787bbd3970c139ceb56) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.044991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.045638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.046264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.046405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.046546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.046822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.051674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 283/575] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/role_assignments?user.id=72c7ab7c53954787bbd3970c139ceb56&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.052540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.057658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:09.062664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.064038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:09.065078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:09.067308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 293/576] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.068337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.078507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.173698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.181419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622bce-f477-4a88-8629-e3764f6294b2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.194764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833784-9be7-4a86-8bc3-580ab52791bf None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.223372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.223985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.224265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.224537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.225239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.225707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.227424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.233968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.234577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.234897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.235224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.236215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 284/577] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.236779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.251266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.252723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:09.268760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.269737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:09.271299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:09.271299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.271299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:09.271299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 294/578] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.271299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.313080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.358724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d59585-04e4-448c-b50f-4093df59b192 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.387452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2caf6-112b-4d7e-8d48-e7a5ef8130a4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.394314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.394924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.395240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.395507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.396231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.396534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.397995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.415411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 285/579] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.416200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.429484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.430018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.430291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.430546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.431244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.431542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.433156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.438869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.444011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 295/580] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.445216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.529732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53e030-4ff5-445f-890a-1bd3c6c2edb1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.548408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d5a8d-7f39-446a-9ad5-a11f53198e84 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.561440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.571560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.572198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.572482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.572756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.583082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.584613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.585968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.586575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.586857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.587162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.587811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.588114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.589482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:09.600737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.601881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:09.602784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:09.602784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.602784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:09.602965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 296/581] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.602965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.604276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 286/582] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.605221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.669833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.713038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77184d2-d145-48e1-929f-1050d08cc12a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.713932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24428df-c0c1-4152-a026-2530ea60294a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.746950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.747641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.747902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.748179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.749978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.750774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.751088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.751365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.759065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.760527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.762846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.764556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:09.776928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.777871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:09.778826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:09.778826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.778826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:09.779490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.780375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:09.781240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:09.781240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:09.781240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:09.782897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 297/583] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.783757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.784982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 287/584] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.785693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.817917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.893139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806e44-f649-4475-9b87-d5d7326a1d02 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.900371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588937-ff8c-476f-a11b-0db2e68c4934 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:09.907381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:09.931395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.932019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.932303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.932634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.937338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:09.937939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:09.938220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:09.938487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:09.939155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:09.939455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.939659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:09.940815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.941108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:09.952833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:09.953751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:09.954642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:09.957461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 288/585] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:09.958341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:09.958690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 298/586] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:09.959475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.057343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.064923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f121c-c21b-4b92-bcf9-f2386299f3cb None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.068235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83641d0a-f615-449f-9711-ef60f44d3466 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.099878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.101103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.101450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.101744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.102386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.102691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.104107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.104473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.105072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.105350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.105620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.106250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.106552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.107926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.117903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 299/587] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.118725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.121422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 289/588] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.122617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.161145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.234342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffc35-be99-4f93-ab99-09cbfce564ea None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.238892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31dfa-a2bc-4756-8a87-d8585f712689 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.271437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.273412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.273881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.274429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.274795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.275439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.275718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.275993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.276680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.276984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.278408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.282966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.284625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.290315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 290/589] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.291133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:10.300942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:10.301899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:10.303120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:10.305185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 300/590] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:10.305967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.310449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.401974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.411588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bd9d-2c78-436d-a49b-ffe3b51da6d0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.413260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2745f-567e-47a7-9492-df3f86cb84a9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.449677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.449899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.450308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.450519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.450631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.450803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.450898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.451099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.458160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.458359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.459744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.459875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:10.470955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:10.471880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:10.472769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:10.473184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:10.474012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:10.474952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:10.476044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 301/591] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:10.476044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.482318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 291/592] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:10.482318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.553442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.583282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d17e1d-b5cb-4c96-9fbd-74622134a35c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.588086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da75da-e00f-4d00-98fa-caae859a86b8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.619636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.620296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.620580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.620865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.629628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.630237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.630520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.631248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.632024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.632430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.633882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.637661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=aa2fa4b0a3974d0e9b04726511427631, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.639138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.653087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 292/593] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.653878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.663224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 302/594] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:10 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:10.664264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.667337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.798562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904e7-ad9a-43e6-b956-36e961cfa258 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.800315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530796e-2914-4fad-884b-97cb673ae663 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:10.836072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.848186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.849043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.849482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.849764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.850719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.851289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.852135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:10.852514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.853201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:10.853695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:10.854362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:10.856155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:10.856698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:10.858326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:10.878353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 293/595] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.878353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.882013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 303/596] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:10.885512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:10.959365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.995094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822992e-8fd5-435f-8279-c8fde5e4b9d6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.012618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d25a-8ca0-4975-9d81-b947b631c1c2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.035725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.036356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.036640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.036916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.048674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.049788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.050108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.050495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.050725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.051025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/25211db01b88403c8e4c9479ea9333c3/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:11.064762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:11.066150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:11.067075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:11.067075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:11.067075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:11.067075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 294/597] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:11.067075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.068354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=25211db01b88403c8e4c9479ea9333c3, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.070608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305899-0442-4ba3-9b80-80482d91bc19 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.091196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 304/598] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:10 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/25211db01b88403c8e4c9479ea9333c3/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:11.095796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c566c6-eacc-42fd-ad64-21c4a30ec591 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.096553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c566c6-eacc-42fd-ad64-21c4a30ec591 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.097018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c566c6-eacc-42fd-ad64-21c4a30ec591 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.098600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 305/599] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:11.099621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c566c6-eacc-42fd-ad64-21c4a30ec591 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.127377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.191143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954abb53-b018-44ac-8e1b-a2eb2c71a198 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.228913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c566c6-eacc-42fd-ad64-21c4a30ec591 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.229422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.230274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.230732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.231247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.243679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.246365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.248830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c653e860-72dd-4f3c-bd7a-ce81fe7a4e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:11.265808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:11.266810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:11.267738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:11.267738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:11.267738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:11.267738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 295/600] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:11.268729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.269883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.269883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.277775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.277775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.278169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.278350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.279045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:11.279331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.280779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.288268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:11.289465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:11.295973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 306/601] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:11.296867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.386076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 296/602] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:11.386968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.409234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb77-4594-40fe-afa2-35f2479cea3a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.431443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.446080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.446742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.447065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.447343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.447996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:11.448296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.449676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.462263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 307/603] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:11.467959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.504400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.572890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b33e0-441e-4e3a-9998-9cf24541b470 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.573715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e094-98d9-457a-b9d0-865f8ff7fb97 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.607764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.608469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.608749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.609024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.617180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.618685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:11.634589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:11.635524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:11.636463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:11.638898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 308/604] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:11.644273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.658022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.658667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.658945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.659237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.676128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.677585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:11.701265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:11.702225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:11.703142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:11.711432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 297/605] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:11.712337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.763328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.775859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146cc2-beb1-4bda-bede-185a145862a1 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.812108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.812751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.813043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.813319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.814015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:11.814324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.815857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.829818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 309/606] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:11.835461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:11.904191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.943250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2791cf7-5043-4156-9932-640e4ae18744 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.948405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c29f16-b1b3-426b-b79a-d086a7ae04b4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:11.981019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.981711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.982057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.982440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:11.983236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:11.983632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:11.985206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:11.994641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:11.996056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:11.996517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:11.997301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/183c8b4ac78f42678d68527a0c6e09ba/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.004045 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 298/607] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:12.004045 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.018407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=183c8b4ac78f42678d68527a0c6e09ba, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:12.019969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:12.033338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:12.040752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 310/608] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:11 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/183c8b4ac78f42678d68527a0c6e09ba/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:12.042921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.128025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe823b-38b6-4435-a5d8-0e1326898a17 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:12.168926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:12.169511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.169699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.169979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.183221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:12.188460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:12.189386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:12.190219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 299/609] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:12.196687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.199997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:12.206059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdff0a-2fb8-47c7-ae89-bbb0cb4c354c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:12.248579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:12.249245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.249245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.249570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/dc6e7b66794e4416ba15562e47e9888f/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.267896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=dc6e7b66794e4416ba15562e47e9888f, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:12.269107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:12.293215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 311/610] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:12 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/dc6e7b66794e4416ba15562e47e9888f/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:12.340891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a02dc-a395-49be-be74-379aeff78116 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:12.383896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:12.384870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.385376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.385862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.386734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:12.387286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:12.388924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:12.399868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 300/611] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:12.405326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.471098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:12.528631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc269-1d42-4047-94d4-8741dd3bcbb5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:12.566732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:12.567802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.568279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.568744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.580110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:12.581829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-a75814b5-2bc4-4be4-8d76-a7cbfeb64231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:12.598215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:12.599217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:12.600111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:12.600111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:12.600111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:12.602688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 312/612] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:12.607951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.682964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:12.726412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f246e8-67c7-471c-ba29-92ff30eb2d8f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:12.762830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:12.763808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.764286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.764773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.765631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:12.766170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:12.767799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:12.777000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fe31-4c75-4e70-8961-6aab8b667311 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.777283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fe31-4c75-4e70-8961-6aab8b667311 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.777547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fe31-4c75-4e70-8961-6aab8b667311 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.783334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 313/613] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:12.784540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:12.784824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:12.785097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:12.790328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 301/614] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:12.794389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:12.808587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:12.809786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:12.887930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 314/615] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:04:12.996003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47dc4-3368-475a-b9b6-78514ed59b0b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.029251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.047682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.048763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.049247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.049790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.059150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.060929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:13.076957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:13.077949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:13.078913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:13.081458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 302/616] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:13.087300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.133631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.220305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86becf-1628-4568-9926-4440db0f9e43 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.256310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.257330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.257611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.257884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.258610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:13.258916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.260362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.278546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 315/617] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:13.283682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.289877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.388230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.399889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faaa33-f5a5-4b5b-8db6-2ba0ce21c1f6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.443030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.443683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.445205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.445496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.456545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:13.462243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:13.463270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:13.464134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 316/618] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:13.469228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.488320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5dec-cb8b-48ab-970d-d00d4d482989 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.560447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.561002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.561283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.561558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.582942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b905fa-e5cf-4abf-9c9f-dd4c723252f6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.585236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.586803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:13.616375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:13.618946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:13.621119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:13.621119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:13.621119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:13.621119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 303/619] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:13.627036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.627285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.627285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.627285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.627285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.627895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:13.627895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.627895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e93e34-dfd6-4a4d-bd1d-21053488cec2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.639867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 317/620] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:13.641119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae46f-8701-471b-8575-80fccee6ca2e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.641402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae46f-8701-471b-8575-80fccee6ca2e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.641676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae46f-8701-471b-8575-80fccee6ca2e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.642999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 318/621] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:13.648812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae46f-8701-471b-8575-80fccee6ca2e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.664640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.679158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.767629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a667-28fc-48c1-904c-6f45c3b67c73 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.768411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae46f-8701-471b-8575-80fccee6ca2e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:13.810217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.810441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:13.810973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.811242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.811520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.811758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.812183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.812590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.813630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:13.814481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.816168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab453573-0953-4dbd-b558-d44277821482 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.823633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:13.825492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:13.835755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 304/622] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:13.836404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:13.836776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:13.836957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:13.847936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:13.848859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:13.849952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:13.849952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:13.849952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:13.853981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 319/623] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:13.854829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.866498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:13.867931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:13.933594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:13.951477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 305/624] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:13.953987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:13.990386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.006704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd60d-0609-45bd-8d79-e7118caa39fd None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.074761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.075336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.075617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.075889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.085064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.086601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:14.100985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:14.101919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:14.102826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 320/625] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:14.107127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.122207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3223bbb-0472-4c65-bb4e-7d367ab2a3ce None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.165371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.166344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.166844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.167352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.168631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:14.169263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.170833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.184338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 306/626] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:14.191942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.296195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061690e3-13ef-4f93-87eb-f753f654ac14 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.343553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.354415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.357569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.358685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.358685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.358873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.359635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:14.359945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.361505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.373439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d173b71-f2b2-449a-8e94-036f5a50e941 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.376610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 321/627] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:14.377258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.411285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.412524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.413033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.413597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.422196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.423977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:14.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:14.438361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:14.439328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:14.442028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 307/628] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:14.443029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.493880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783324-e454-4195-b4b4-f3667071fcce None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.535128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.535773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.536054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.536476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.548752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:14.552160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd92cf-0fbc-450d-b814-b80d7b4ba482 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:14.554145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:14.555294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 322/629] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:14.556169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.593021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.593738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.593973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.594253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/72c7ab7c53954787bbd3970c139ceb56/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.606391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.609047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=72c7ab7c53954787bbd3970c139ceb56, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.610511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f324e-36d6-4b07-a98e-6af395c4a8c4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.613745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.625266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 308/630] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:14 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/72c7ab7c53954787bbd3970c139ceb56/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:14.626585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6164-2b4b-4946-be08-4548c2b447bb None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.626992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6164-2b4b-4946-be08-4548c2b447bb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.627410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6164-2b4b-4946-be08-4548c2b447bb None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.631031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 309/631] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:14.631031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6164-2b4b-4946-be08-4548c2b447bb None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.668230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade6aa3-4384-4de8-b3d4-acc1915df08c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.706236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.706868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.707200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.707444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.708187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:14.708506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.710566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea100ec-6424-4be7-8b3d-6bea3708bfca None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.730244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 323/632] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:14.731372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888472d4-c9e6-43b7-9983-8c11a20aa453 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.731658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888472d4-c9e6-43b7-9983-8c11a20aa453 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.731935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888472d4-c9e6-43b7-9983-8c11a20aa453 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.733367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 324/633] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:14.734258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9cc12-df78-4153-ab6f-3e9fc0c443d6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.734699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9cc12-df78-4153-ab6f-3e9fc0c443d6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.734798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9cc12-df78-4153-ab6f-3e9fc0c443d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.754006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b3a9cc12-df78-4153-ab6f-3e9fc0c443d6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:14.754502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6164-2b4b-4946-be08-4548c2b447bb None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.755260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b3a9cc12-df78-4153-ab6f-3e9fc0c443d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:14.798385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.799330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.799682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.800025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.800762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:14.801139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:14.802575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:14.811556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 310/634] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:14.812373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.838923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 325/635] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:14.840553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.840967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.841365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:14.860859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:14.862308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:14.893672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.905052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:14.940822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 326/636] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:14.941673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:14.951557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8a5c3-abbe-4788-b3da-01b5f9693148 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:14.988094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:14.989200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:14.989636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:14.990086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.064650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.066367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.106328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c426-fb0e-46a1-b9fa-aff8f5bc3696 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.127722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.144572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.145203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.145482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.145755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.157364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.158883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:15.179260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:15.180390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:15.181484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:15.181484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:15.181484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:15.181692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 311/637] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:15.184585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.184881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 327/638] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:15.185863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.203606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.307349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b9b9-85bb-4ef3-a616-06abcea6a014 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.310179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd2cb-a4dd-4f75-9703-116f54300906 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.343933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.344684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.345035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.345377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.345603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.346295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.346656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.347012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.358081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.358595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:15.359730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:15.363797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:15.365042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:15.366806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:15.367650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 312/639] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:15.367932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:15.387036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:15.388028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:15.388939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:15.388939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:15.388939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:15.388939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 328/640] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:15.389674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.390471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.462194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.480753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8984-1978-4068-8d63-48701d935646 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.505555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47ee2-abad-4fd1-bec7-66ee1982a862 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.517060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.517662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.517942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.518230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.518869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:15.519208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.520586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.537057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 313/641] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:15.537057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.545326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.546018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.546357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.546834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.558172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:15.563451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:15.564458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 329/642] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:15.565337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.619860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.643513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458eae9-f493-4f0d-8eb7-f8048eb14d51 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.674400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2817c-c447-4be7-a3ae-010c427614db None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.678830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.679689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.679972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.680247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.680959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:15.681394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.682769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.696689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 314/643] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:15.696689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.706569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.717531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.718268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.718653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.719057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.719851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:15.720175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.721649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.738189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 330/644] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:15.738189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.821084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4d0c-4157-402b-af1f-965c5e23cd71 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.859707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412362-b507-47c4-9061-cb07c17f4476 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:15.861136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.861771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.862051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.862333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.871236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.872703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.875416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:15.885775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:15.886934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 16:04:15.888298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:15.888906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 315/645] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:15.889707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.905502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:15.906031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:15.906316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:15.906594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:15.907291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:15.907598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:15.908970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:15.921332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 331/646] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:15.921332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:15.967472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f203d-fe68-4e88-8ea2-118faafd60bc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.023771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a848-d97d-4103-941b-771ddd6d6aec None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.051399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.052418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.052800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.053475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.058926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.059601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.059886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.060164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.066510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.067707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.068495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.069251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:16.081695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:16.082662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:16.092498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 332/647] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:16.093125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:16.094188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:16.098262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:16.098262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:16.098262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:16.098476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.098561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 316/648] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:16.098561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.150829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.200395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194179-ce61-48ea-bee8-f133d9edefbf None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.202817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7af02a-d6ed-417a-97af-617b0d1e4958 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.209700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.237088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.237460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.237698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.237981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.238078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.238254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.238357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.238874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.239262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:16.239573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.241529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.250347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.251826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.265595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 333/649] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:16.265595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:16.271753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:16.272690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:16.273568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:16.273568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:16.273568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:16.273568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 317/650] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:16.273810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.375177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba6f4-bc71-4076-b987-a0679faf17dd None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.384696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a06d-3bbe-4fad-90d7-0ed705a557e7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.388001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.412435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.413685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.413982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.414257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.414948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:16.415305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.416743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.423837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.424156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.424442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.424719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.425364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:16.426037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.427094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.434038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 334/651] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:16.434038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.451934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 318/652] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:16.451934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.458102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.535621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb30-3ce1-40dd-acf5-2e5d91fb8f67 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.563673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594361-8e03-474f-8c9e-aa8e15b9a519 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.571183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.571794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.572082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.572359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.603678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.604291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.604573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.604862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.605484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:16.606020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.607174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.623497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 319/653] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:16.624541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.646435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.648468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.651391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.674251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.725493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b6-47a5-48e2-9e5c-7837c7a8479d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.747457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 335/654] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:16.748159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.763939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.764546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.764831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.765105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.765828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:16.766139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.767606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.773406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 320/655] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:16.774485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.876500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4daf-4e2b-4d65-bfe7-0c1b219989c5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.888196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.906673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440ddc-de1e-482b-9442-c7e817b63440 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:16.910281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.923395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.924392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.925200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.925816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.935358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.936820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.948148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:16.948795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.949075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.949350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-b91616c3-dd5b-42a5-a39d-e10fbf6c2e2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:16.949715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:16.950663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:16.951670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 336/656] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:16.952878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6356-4f09-4f89-a67c-ca983482f3fb None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:16.953167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6356-4f09-4f89-a67c-ca983482f3fb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:16.953444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6356-4f09-4f89-a67c-ca983482f3fb None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:16.954826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 337/657] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:16.955464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb6356-4f09-4f89-a67c-ca983482f3fb None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:16.961379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:16.963084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:16.976139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:16.977073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 321/658] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:16.977996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.080838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb6356-4f09-4f89-a67c-ca983482f3fb None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.088028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f50723-0163-4f61-bbe4-cda75fbb82a4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.118038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.118828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.119455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.119749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.124607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.125240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.125526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.125795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.126526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:17.126830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.128299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f405-5b57-4c5f-a66b-1856cb522bb0 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.132420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.133918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.150775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 322/659] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:17.150775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.150775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.150775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:17.151889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:17.152803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:17.153722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:17.153722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:17.153722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:17.153722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 338/660] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:17.153722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.166033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.172095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:17.173294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:17.196731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.253155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 323/661] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:17.259016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.289378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131a4b7-a10e-4ea5-bd55-e75aee7f6832 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.333281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.333281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.333582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.333810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.336196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:17.336196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.337450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.379002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 339/662] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:17.379002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.483011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8bf1-cdf3-45e9-8481-bf7451de3464 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.543430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.548622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.549239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.549522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.549800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.552813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b148b4-703a-430f-a54d-5ba897a29c8c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.553410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.595950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.597838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.598123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.598398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.599073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:17.599382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.601691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.619142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 340/663] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:17.620126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.632088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.634073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.739033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df0d2-c66c-4c99-aa03-b2b54fe7ce3b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.760749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 324/664] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:17.761960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.780095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.780699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.780980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.781252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.801643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.807678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.859296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:17.860766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:17.883407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d296-dd7d-48f7-a444-55b19227c6fb None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:17.921946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:17.922579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:17.922857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:17.923165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:17.935244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:17.940198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:17.941207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 325/665] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:17.944126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:17.974496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 341/666] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:17.976171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.037197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.046057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.053978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca88b42-ebb8-4bed-967a-a4b61fee82fe None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.082697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560c84-6da0-4400-a3fe-6508b7321998 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.094266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.095138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.095569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.095999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.103621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.105255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:18.116907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:18.117953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:18.119072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:18.119583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.119583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.119583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.119583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.121071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 326/667] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:18.121985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.134376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.135876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:18.151966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:18.153129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:18.154184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:18.154184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.154184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:18.155571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 342/668] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:18.156480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.237322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58dd10-651f-4db1-bc63-5c41f6ee7aef None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.269750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030aff-8036-4c43-9de2-8a6877e769a0 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.271561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.272804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.273087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.273366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.274031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.274332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.275724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.280255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.288574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 327/669] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.288574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.306398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.313335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.313972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.314254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.314527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.325988 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.327484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:18.344213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:18.345180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:18.346091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:18.346091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.346091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:18.346091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 343/670] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:18.346091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.397521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6eb25-86f8-47b8-af93-6e7659ec0c19 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.433110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.433700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.433987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.434256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.435020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.435328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.436748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.453622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 328/671] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.453622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.462493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089301-6c3a-4b4a-badf-1859d1c8024e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.499619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.500286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.500569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.500864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.501503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.501808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.503244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.515385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 344/672] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.516102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.538539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.541819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.564321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7c49-3cfc-4c5e-8a16-f60a1cd7fb3c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.601250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.602109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.602477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.602813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.613447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.615187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.630261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d5b3-61f1-4ed7-956c-22055b06ff39 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:18.630787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:18.632409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:18.633291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:18.633291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:18.633291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:18.633291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 329/673] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:18.634019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.674421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.675261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.675545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.676223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.676879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.677181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.679568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.691075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 345/674] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.696798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.741970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559b7d-b78a-4afd-973e-e04a99d5ca31 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.770586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.777269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.777868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.778146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.778420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.779207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=25211db01b88403c8e4c9479ea9333c3) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.779518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.780962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.786582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 330/675] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/role_assignments?user.id=25211db01b88403c8e4c9479ea9333c3&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.786723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.787435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.809165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3447e-ddeb-4901-8065-fefd906c2901 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.858793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.859470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.859750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.860022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.868593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.870256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:18.884171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:18.885179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:18.886076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 346/676] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:18.887325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:18.922491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef7e7-0dc4-4c05-b88d-d52b26dbe187 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:18.958415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:18.959132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.959345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.960139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.960781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:18.961174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:18.962579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df0ab-6900-47ef-bc33-4ec7e9dd0e4c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:18.974941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 331/677] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:18.976601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174c07-7d92-4763-9d5b-0512cb8ff5b0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:18.976885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174c07-7d92-4763-9d5b-0512cb8ff5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:18.977160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174c07-7d92-4763-9d5b-0512cb8ff5b0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:18.978356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 332/678] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:18.979071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41174c07-7d92-4763-9d5b-0512cb8ff5b0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.005018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4212-c5ea-4a82-b69c-4e8384191f30 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.044836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.046412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.047138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.047433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.047838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.054764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.056248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.058735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:19.069665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:19.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:19.071827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:19.073821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 347/679] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:19.074749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.101254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41174c07-7d92-4763-9d5b-0512cb8ff5b0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.137890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.138786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.139308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.139586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.140292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:19.140595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.142030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb6dfb-735e-4b04-a0ea-a7ccce670101 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.159017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 333/680] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:19.159017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.159017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.159017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.175002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:19.176218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:19.186311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033743d7-df6f-4669-846a-c8db179a1718 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.222164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.222914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.223228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.223501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.233004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.234566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:19.247688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:19.248679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 348/681] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:19.249645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.256187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 334/682] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:19.257492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.315179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.326580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.377777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b0526-3965-4b2d-9a0a-e233a3008183 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.399323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cb80f-1b79-44ec-b240-c67a87e2eb81 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.420899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.421513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.421791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.422065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.422752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:19.423084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.424531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.440427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.441327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.441813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.442444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.443418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=183c8b4ac78f42678d68527a0c6e09ba) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:19.444014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.445651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.447981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 349/683] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:19.449354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.452895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 335/684] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/role_assignments?user.id=183c8b4ac78f42678d68527a0c6e09ba&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:19.453971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.579626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eea80-e5fc-4b58-8953-81bfc4845e0a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.603609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.614989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207630d4-0d84-4232-ae16-7cc2770affae None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.620348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.620947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.621223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.621494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.622227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:19.622530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.624130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.626264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.647334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 350/685] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:19.648517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.655422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.656034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.656313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.656586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.657413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=dc6e7b66794e4416ba15562e47e9888f) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:19.657728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.659187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:19.666047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 336/686] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/role_assignments?user.id=dc6e7b66794e4416ba15562e47e9888f&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:19.666857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.806552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f7d73-4eb6-4be8-9ab6-9b2d4b38dd07 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.825364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df0bf-ef0c-488f-9fa7-d0f7d7cb281a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:19.863418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.864308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.864894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.864894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.877789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:19.882783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:19.883942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:19.884947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 351/687] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:19.889592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:19.892944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:19.893484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:19.893762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:19.894035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:19.943066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.952553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.996231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:19.998138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.018853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508049f7-92d2-4241-b126-10b6077ca002 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.064309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.064970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.065252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.065524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.066192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:20.066617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.068176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.078328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 352/688] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:20.087561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.115085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 337/689] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:20.117492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.189300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:20.211091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daea39-163f-4815-a589-60b1d690c073 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.215694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:20.245923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1a7a-4da0-4abb-907b-b46818b18078 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.267161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.267799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.268079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.268349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.289423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.290895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:20.314357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:20.315390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:20.316311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:20.316311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:20.316311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:20.319527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.319527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.319527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.319527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.320058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 353/690] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:20.322869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.339424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.340902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:20.364278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:20.365282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:20.366238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:20.366238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:20.366238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:20.368127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 338/691] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:20.373544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.479484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118238-0074-4488-8d67-c9a40271c318 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.551235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.551844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.552126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.552401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.553289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:20.553601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.555718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843105ff-d886-49ab-8ac8-ffcf67debc5e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.558346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.579102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 354/692] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:20.583155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.598346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:20.601964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:20.621360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.621978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.622260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.622535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.623208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:20.623515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.625177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.653257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 339/693] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:20.659810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.747181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6dee0-5c7b-4d26-acdd-f6886631199d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.813066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.814008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.815035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.817474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1418e-c4e2-4539-82aa-0eb928e59948 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:20.817698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.834215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.836272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:20.862235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:20.863560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:20.864746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:20.868132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 355/694] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:20.877108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.910784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:20.911431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:20.911716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:20.911987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:20.929241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:20.931047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:20.950121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:20.951133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:20.952050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:20.956453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 340/695] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:20.961545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:20.966295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.000058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9d03c-3b9a-456b-a34b-46c8d1760502 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.016941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.039217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.040142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.040637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.041121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.042100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:21.042600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.044245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159c5a-b8f7-40aa-8492-df973b656ec1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.062175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 356/696] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:21.063728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286651-ac33-4615-9a0e-02b9e1df7c21 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.064252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286651-ac33-4615-9a0e-02b9e1df7c21 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.064722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286651-ac33-4615-9a0e-02b9e1df7c21 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.066551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 357/697] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:21.067497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51286651-ac33-4615-9a0e-02b9e1df7c21 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.081918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b860d81-99f7-47b0-91d0-1a65b87af40e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.123565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.124186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.124471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.124753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.125468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:21.125778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.127471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcb379-470d-4fb5-bdc6-2efe6f5a5de5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.146252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 341/698] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:21.148304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.148602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.148882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.168756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:21.169975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:21.178621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51286651-ac33-4615-9a0e-02b9e1df7c21 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.208186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.216056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.216984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.217463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.217932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.259375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 342/699] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:21.260231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.291643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.293446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.314574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.399318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 358/700] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:21.404404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.440332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0d50d-173b-4fa8-879b-985e2cf51580 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.459329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.498695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.499682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.500558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.501168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.502096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=72c7ab7c53954787bbd3970c139ceb56) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:21.502672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.504435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.511558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 343/701] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/role_assignments?user.id=72c7ab7c53954787bbd3970c139ceb56&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:21.570172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256d34-916d-4d32-849a-d33150dd6f1a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.607439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.608900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.609380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.609950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.622597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.624475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:21.641238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:21.642248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:21.643199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:21.643199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:21.643199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:21.645382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 359/702] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:21.652215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.719449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:21.799637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.805424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb942e-5f17-4e15-80a3-c7e113d5194c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.819917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.848017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.848637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.850817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f9fb-1daa-4be1-9584-76925a871d4a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:21.850963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.850963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.851582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:21.851884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.853262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19958ca1-286e-4684-b035-2fc0866c145b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.871477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 344/703] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:21.871990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f73d-b345-4b2c-b103-bac9f8550f7a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.872273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f73d-b345-4b2c-b103-bac9f8550f7a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.872545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f73d-b345-4b2c-b103-bac9f8550f7a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.873977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 345/704] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:21.880163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.880445 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.880719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.897342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:21.898139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:21.898428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:21.898708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:21.901908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:21.903112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:21.910780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:21.912277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:21.931246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:21.932263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:21.933761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:21.933761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:21.933761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:21.933761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 360/705] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:21.934374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.007331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 346/706] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:22.007331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.073076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a292-ffa2-4887-b933-43963d3d9a89 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.112310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.112949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.113233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.113509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.121101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.123206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.125068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:22.139248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:22.140214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:22.141434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 361/707] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:22.146460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.187368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.204354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6193-2537-4555-9390-1858e1a2f350 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.247778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.248400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.248685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.248960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.249615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:22.249924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.252231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706b8-4131-42a4-97db-3f70e66c5ed4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.268432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 347/708] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:22.269986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d53b3-23f2-4e35-82f3-1307e4a5f4a3 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.270498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d53b3-23f2-4e35-82f3-1307e4a5f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.271008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d53b3-23f2-4e35-82f3-1307e4a5f4a3 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.273389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 348/709] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:22.274309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d53b3-23f2-4e35-82f3-1307e4a5f4a3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.293091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cee7b1-21f9-4b10-9c7b-e12113548413 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.330774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.331330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.331689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.332007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.332758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:22.333070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.334534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c6e6-0fcc-42f5-b697-18336b2979ed None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.347739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 362/710] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:22.348929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.349218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.349495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.368884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:22.370685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:22.401358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d53b3-23f2-4e35-82f3-1307e4a5f4a3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.427234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.437816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.438512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.438705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.438966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.439846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.441062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.455013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 363/711] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:22.455013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.471772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 349/712] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:04:22 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:22.473023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.477673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.632600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3947602-1a39-467f-b36e-b60703b00e7f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.652001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f26b6-eabc-4ddc-ad5d-29fa4a2f8b2a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.684120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.685153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.685639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.686818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.687685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.689308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.692063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.693338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.693769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.694518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.695436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:22.695916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.697486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:22.701253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:22.702473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:22.703408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:22.706942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 350/714] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:22.707102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 364/714] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:22.714701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.775396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.810730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.860803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57035-03cb-45c9-a728-afbc01eb90a4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:22.909867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:22.910746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:22.910866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.911298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:22.911738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:22.912533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] RBAC: Adding query filter params (name=network) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:22.913332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:22.915467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:22.920896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 365/715] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:22.926868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:22.955739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32410a-4b8a-4a23-910d-266dd06aa95e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:23.004705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:23.005875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.008620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.009743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.010735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:23.013376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:23.034158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:23.035283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:23.036133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 351/716] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:23.041757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:23.091873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908e5b-d266-47a0-994e-2a707c4f1f8e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:23.121937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:23.165302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:23.165839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.166115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.166391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.167101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:23.167414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:23.173003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:23.186152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 366/717] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:23.231110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234866c-7a75-4c61-ac96-958b2ed795f6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:23.268945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:23.278813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:23.279521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.279807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.280080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.280771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:23.281080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:23.282484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222322-941a-43e1-81be-82e1a836e3a1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:23.288471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 352/718] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:23.294347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:23.425577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4969-8a88-4019-b44a-f13324da0fa5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:23.470903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:23.471545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.471830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.472143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.472779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:23.473081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:23.474452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564bb2c-092b-4ca1-a12c-3eb0db7fde81 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:23.480440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 367/719] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:23.776507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ed1f-e857-44db-8c09-c6981f22b17d None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.777061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ed1f-e857-44db-8c09-c6981f22b17d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.777061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30ed1f-e857-44db-8c09-c6981f22b17d None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.778590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 353/720] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:23.783728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:23.784126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:23.784308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:23.809500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:23.810680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:23.856470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:23.902414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 368/721] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:24.314558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30ed1f-e857-44db-8c09-c6981f22b17d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:24.448788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30ed1f-e857-44db-8c09-c6981f22b17d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:24.499976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:24.500867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.501299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.501748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.514349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:24.519507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:24.520644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:24.521682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:24.524586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 354/722] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:24.529974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:24.669795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeef11c-fbf1-432f-acbf-bbaeba8e8130 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:24.718689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:24.719587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.720019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.720467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.721301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:24.721758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:24.723316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a7157-9cde-43cb-8b15-ed0e27cbe168 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:24.739112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 369/723] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:24.745502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:24.825571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:24.899248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac49e67-594e-4111-9b70-d91c5766c537 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:24.949221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:24.950116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.950550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.950998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.966601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:24.968288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:24.979155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5022-cfef-4015-aebb-c91a0aa96414 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.980088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5022-cfef-4015-aebb-c91a0aa96414 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.980572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5022-cfef-4015-aebb-c91a0aa96414 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.982131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 370/724] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:24.984287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:24.985240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:24.986148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:24.986148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:24.986148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:24.986148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 355/725] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:24.990234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefee43-8c20-4559-b78c-937a546614f5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:24.990616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefee43-8c20-4559-b78c-937a546614f5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:24.991382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefee43-8c20-4559-b78c-937a546614f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:24.995143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.023170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1aefee43-8c20-4559-b78c-937a546614f5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:25.024382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1aefee43-8c20-4559-b78c-937a546614f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:25.072077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.132501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 371/726] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:25.133947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7615e-06db-4217-902e-5e3fd628f87e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.134235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7615e-06db-4217-902e-5e3fd628f87e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.134513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7615e-06db-4217-902e-5e3fd628f87e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.136079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 372/727] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:25.141653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.141943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.142216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.163746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:25.165235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:25.166016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03caf-4458-429b-9559-f520d1f30a1e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.185389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.243289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 373/728] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 16:04:25.281082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.281697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.281975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.282241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.282883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:25.283209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:25.284610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:25.308469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 356/729] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:25.313626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.445163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.462433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe359c-3227-41a2-9d1d-daf9cb017950 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.473056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.501605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.502157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.502572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.502846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.511367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:25.513095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:25.525963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:25.526938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:25.527949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 374/730] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:25.532978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.642370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a027-6397-4c4f-a1c8-b61762d73713 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.678209 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.679410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.679691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.680075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.680812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:25.681119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:25.682565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:25.702681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 375/731] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:25.708607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.723011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.748667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e340-37a1-4b9a-9f0f-42f664cb1b57 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.783475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.784029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.784308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.784576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.795204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:25.800122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:25.801075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 357/732] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:25.801962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:25.830784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61528-e032-4343-b8c6-374dd862e381 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.835176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.867609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.868218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.868503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.869091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.924753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fdab2-7daa-4b81-90bd-cb716fcf671f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:25.941699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:25.943481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:25.956049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:25.962006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:25.962724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.962925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.963220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.973583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6400cc55-db3f-499e-8fa0-42550d2bda54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:25.978609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:25.979654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:25.980590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 358/733] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:25.981278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b012b7-ac5b-4537-b5bc-a5d776ad0ff3 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:25.981723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b012b7-ac5b-4537-b5bc-a5d776ad0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:25.981815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b012b7-ac5b-4537-b5bc-a5d776ad0ff3 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:25.983154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 359/734] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:25.983704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b012b7-ac5b-4537-b5bc-a5d776ad0ff3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.059756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 376/735] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:26.060510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.077735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.091598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b012b7-ac5b-4537-b5bc-a5d776ad0ff3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.124789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.125385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.125668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.125943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.127004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:26.127004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.128283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7af2-d181-4364-b659-269eefcd933d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.136702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 360/736] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:26.137637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.137918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.138193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.155841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:26.157033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:26.160413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37d27f-0f70-4eb1-a636-144d427d3b6c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.170791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.193837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.195206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.195493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.195771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.196472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:26.196750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.198172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279c2c-8aeb-4d96-af42-394f9006b52d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.206211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 377/737] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:26.207945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d3dd-ecca-40f3-8a50-4a36583efc0b None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.208230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d3dd-ecca-40f3-8a50-4a36583efc0b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.208502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d3dd-ecca-40f3-8a50-4a36583efc0b None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.209918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 378/738] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:26.210436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d3dd-ecca-40f3-8a50-4a36583efc0b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.223198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 361/739] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:26.224263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.314070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.317158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d3dd-ecca-40f3-8a50-4a36583efc0b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.337176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0499a7-82ee-47cc-84cc-cb8ab8de4855 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.351595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.352227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.352517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.352795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.363093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.364810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.375320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.376149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.376630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.377066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:26.378790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:26.379898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:26.380862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:26.380862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.380862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:26.380862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 379/740] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:26.381093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.396506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.398062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.411929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-cfdd41f3-e20c-4b3b-8e68-2ec24f8adecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:26.414224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:26.415353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:26.416438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:26.416438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.416438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:26.422495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 362/741] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:26.422495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.422495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.422495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.439996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:26.441340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:26.499065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f587-f112-4e14-8ec2-065f6e814950 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.512034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 363/742] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:26.512874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.536678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.537361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.537662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.538497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.550191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.551768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:26.566100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:26.567080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:26.573432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:26.573432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:26.573432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:26.573432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 380/743] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:26.573432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.588958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.632375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a137b-6547-439e-9810-4ea0999e33eb None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.648312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.669273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.669941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.670229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.670635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.671367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:26.671670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.673063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.673678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cce3d-9289-42bf-8993-d1c61470dc55 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.690307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 364/744] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:26.690307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.715949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.716524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.716802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.717098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.717696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:26.717995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.719457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.731565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 381/745] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:26.732283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.799317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6e19-dfde-4443-a5af-8f295c9d18b4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.821976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.833223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fe29-90d6-4da4-b0ad-de9a61d24659 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:26.833460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.834074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.834355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.835190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.835885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.837262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.853465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 365/746] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:26 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:26.860596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.879550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.885479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:26.886096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:26.886376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:26.886648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:26.887368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:26.887673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:26.889170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:26.907301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 382/747] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:26.907301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:26.982483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b01e-88e1-4c46-a82b-57ecfd110d40 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.017517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36e5e-88ce-4cff-a189-02fcafadd808 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.025340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.026433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.026721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.027062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.036750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.037464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:27.049327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:27.050422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:27.051590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 366/748] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:27.052191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.058969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.059712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.060064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.060594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.068538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.070653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:27.082476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:27.083618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:27.084762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 383/749] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:27.085608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.105808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.147952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.167975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad996d-d7a2-4794-9e41-7b755de39fff None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.203155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf77e7-52a9-4bdb-a463-01a8d1bfbbcc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.205323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.205927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.206203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.206475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.207162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.208909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.227034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 367/750] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:27 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:27.227034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.267228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.268171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.268653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.269077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.283169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.285716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:27.303505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:27.304712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:27.305896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:27.313611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 384/751] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:27.313611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.365495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4e57-df33-4da0-b8c6-7e3abbd7d24e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.368483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.417921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.419168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.419462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.419735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.420588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:27.420900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.422348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.428109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cf76-6b35-4bb3-8dfc-70d04649b112 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.436261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 368/752] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:27.437192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.441768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.478087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.479376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.480316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.481066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.482303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:27.483248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.485203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.514384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 385/753] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:27.515616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.563607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c00cb-a99d-48b4-8d5f-fecd401d9a96 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.607819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.608422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.608700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.608974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.609951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:27.610073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.611512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.636091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 369/754] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:27.637892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.645178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfe70-362f-4b58-a3bf-632cd9d52bde None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.661526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.681477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.682077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.682355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.682625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.683368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=72c7ab7c53954787bbd3970c139ceb56) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:27.683672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.685097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.691138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 386/755] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/role_assignments?user.id=72c7ab7c53954787bbd3970c139ceb56&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:27.692057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.724722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:27.795424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b897-13be-47a5-87f6-807a146aac41 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.802510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e1e8-9c64-4e14-97e4-62f05743de7c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:27.842966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.843806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.844235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.844633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:27.857490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:27.859373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:27.875574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:27.876797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:27.877917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:27.877917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:27.877917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:27.879825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 387/756] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:27.886856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:27.898436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:27.899742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:27.900170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:27.900612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.000667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.021936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464ac9-c67b-452e-b602-71bb7a6ecd67 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.051953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.053452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.085265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.085967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.086143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.086419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.087341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:28.087656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.089044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.098322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.115688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 388/757] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:28.121064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.250108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 370/758] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:28.255722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.286081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb947e0f-d865-42ff-a087-8ca456e7c226 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.323057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.323698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.323979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.324252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.331355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.333000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:28.345592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:28.346541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:28.347453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:28.349191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 389/759] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:28.354008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.360297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.404967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b04120-13a5-4def-be57-efd5b106ed30 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.431436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.441913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.442556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.442842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.443144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.454328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.455842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:28.472226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:28.473235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:28.474134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:28.474134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:28.474134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:28.474134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 371/760] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:28.479277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.595404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71c4e-e3bc-4e31-8390-2d17c9f1acc8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.618031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf8b5-ad65-4e60-b90e-12c6c554f5d5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.631190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.632722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.633222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.633693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.634950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:28.635377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.636774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.650414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 372/761] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:28.655767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.701652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.761837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.762505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.762789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.763085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.763843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:28.764152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.765598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.767519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34baa-a664-43b9-90cb-9ef57e8db80a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.806526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:28.807235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:28.807517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:28.807794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:28.809210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 390/762] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:28.814880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:28.815891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.816613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:28.828559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:28.829487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:28.830382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 373/763] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:28.839027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:28.947397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:28.962806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a7ed-b7f1-41d7-9c9a-446ad2272b1f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:28.976558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:29.004952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:29.005561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.005842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.006115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.007513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:29.007885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:29.009328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c529d7-9e4a-47fe-8b43-4bb66c0f334d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:29.023561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559fd-f9c1-4dcf-86fb-67256a19fae9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:29.023896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 374/764] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:29.025148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8a35-818b-4b7c-99a5-e7f5e7ac0aae None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.025439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8a35-818b-4b7c-99a5-e7f5e7ac0aae None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.025712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8a35-818b-4b7c-99a5-e7f5e7ac0aae None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.031191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 375/765] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:29.032007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8a35-818b-4b7c-99a5-e7f5e7ac0aae None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:29.067963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:29.069341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.069737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.070014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.072243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=aa2fa4b0a3974d0e9b04726511427631, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:29.073695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f31c-8537-4f4d-84d5-d48c679222c5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:29.090139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 391/766] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:28 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:29.091672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.091963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.092243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.114340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:29.115647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:29.152020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8a35-818b-4b7c-99a5-e7f5e7ac0aae None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:29.191649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:29.192297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.192711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.192990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.194479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=ea26d0ce8e3540289d31c4981db0596a) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:29.195017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:29.196732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ba7a-077a-4b3c-83e0-9f653122992a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:29.200009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 392/767] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:29.209126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 376/768] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:29 2022] GET /identity/v3/role_assignments?user.id=ea26d0ce8e3540289d31c4981db0596a&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:29.483977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:29.543054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:29.552844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7e1e-0d56-4fcf-affc-335c175b5e7a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.553122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7e1e-0d56-4fcf-affc-335c175b5e7a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.554042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7e1e-0d56-4fcf-affc-335c175b5e7a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.556215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 377/769] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:29.564373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.564685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.565026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.596208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:29.597493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:29.598907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6be64-5611-4af7-825c-ec1252a796a4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:29.621084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:29.641341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:29.641981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.642263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.642533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] PATH_INFO: `/v3/services/network` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.643150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:29.644954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:29.654673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:29.657082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:29.658727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 393/770] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:29 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:29.661856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:29.760707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 378/771] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:29.828830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0f9c-ba68-40d9-ad5f-39c55133b2da None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:29.855338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:29.888741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:29.889419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:29.889702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:29.889975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:29.890612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:29.890917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:29.892333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974063-a808-42aa-9b17-39ee86de31a0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:29.897693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 394/772] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:29.902932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.009129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ebd50-00de-4022-adbe-2dad35e4ce93 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.017104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01498-d672-455e-91a4-1fead59003bd None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.017329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01498-d672-455e-91a4-1fead59003bd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.017601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01498-d672-455e-91a4-1fead59003bd None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.019097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 395/773] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:30.025397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.025397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.025397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.044106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:30.045644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:30.049904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.050582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.050871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.051169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.051812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] RBAC: Adding query filter params (type=network) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:30.052116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.053524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.060206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 379/774] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:30.065636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.083945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:30.123193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 396/775] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:30.124158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.179508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39f08-5405-44bf-a887-fea1d0266c47 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.216276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.216881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.217160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.217431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.218237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] RBAC: Adding query filter params (interface=public, service_id=275329d335254e17ac31b4d054108675, region_id=RegionOne) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:30.218550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.220003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.230083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 380/776] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/endpoints?service_id=275329d335254e17ac31b4d054108675&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:30.239249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.323951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:30.344762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8a8df-4a09-4b4d-b5ef-9ab7a742cfde None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.380794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.381782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.382070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.382414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.383100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.384644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.390356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 381/777] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:30.416090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.435047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a269-4b77-45b2-b934-306a18ce6720 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.451364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:30.534736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65956713-e785-4b34-b1d4-7f15b3fcd523 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.535729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.536390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.536677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.536949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.537547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.539047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:30.560946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:30.562002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:30.563499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 397/778] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:30.568008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.575175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.575762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.576047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.576324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.584859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:30.590800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:30.595711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:30.598002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:30.600052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 382/779] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:30.608537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.729098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c2fb-f005-4785-b98b-6aebd5552478 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.748732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b724b90-3946-4da4-81d3-a07e474a2234 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.771018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.771526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.771811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.772266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.772911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:30.773250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.774636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.779912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 398/780] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:30.784949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.820956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.821656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.821875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.822147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.822823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:30.823147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.824517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.831768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:30.854347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 383/781] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:30.864906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:30.921533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837489c-1c8a-4e99-b5f7-f3287263ff73 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:30.957148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:30.958177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:30.958670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:30.959186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:30.960605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:30.961122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:30.962704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:30.968712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 399/782] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:30.974207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.012552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.094453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfff4c-8686-4b46-bcdf-c1f97871480b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.172280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.173008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.173290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.173559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.176620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786a13-c469-4999-8a02-04d6570058e6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.181081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.208058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.210079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.216358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b88336-68a5-431c-8937-7482703876bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.217215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88336-68a5-431c-8937-7482703876bb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.217503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88336-68a5-431c-8937-7482703876bb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.217782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88336-68a5-431c-8937-7482703876bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.218490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b88336-68a5-431c-8937-7482703876bb None admin] RBAC: Adding query filter params (interface=public, service_id=3152c950475d417e8d993c763b535c33, region_id=RegionOne) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:31.218797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b88336-68a5-431c-8937-7482703876bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.220681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b88336-68a5-431c-8937-7482703876bb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.229654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 400/783] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/endpoints?service_id=3152c950475d417e8d993c763b535c33&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:31.237246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b88336-68a5-431c-8937-7482703876bb None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:31.250475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:31.251558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:31.252451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:31.252451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:31.252451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:31.252451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 384/784] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:31.257988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.403285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b88336-68a5-431c-8937-7482703876bb None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.443609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.444765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.445318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.445593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.446603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.448082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d570-0dc8-44c8-abc9-378953c5fad6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.454320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 401/785] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:31.492809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140d30a-65ff-410d-be8a-c6a0f20a2066 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.498517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be20f0-4b34-49d4-80e0-61973b767a93 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.498824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be20f0-4b34-49d4-80e0-61973b767a93 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.499132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be20f0-4b34-49d4-80e0-61973b767a93 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.500929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 402/786] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:31.506831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6743-7fd4-4588-a689-0f5e91a0ec32 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.507153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6743-7fd4-4588-a689-0f5e91a0ec32 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.507398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6743-7fd4-4588-a689-0f5e91a0ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.518131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.531300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-dc4e6743-7fd4-4588-a689-0f5e91a0ec32 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:31.532883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dc4e6743-7fd4-4588-a689-0f5e91a0ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:31.575369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.581140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.582108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.582599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.583154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.584073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:31.584679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.587514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.612130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 385/787] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:31.617872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.627152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 403/788] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:31.636386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa62b7-9733-4850-922f-220561f9391e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.636693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa62b7-9733-4850-922f-220561f9391e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.636949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa62b7-9733-4850-922f-220561f9391e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.638410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 404/789] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:31.648612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.648940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.649166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.670706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:31.671958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:31.747105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 405/790] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:31.757946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95456afb-5a96-4f53-bebc-6deec59264c3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.797453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:31.798088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:31.798365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:31.798635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:31.807125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:31.808569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:31.824882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:31.826467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:31.827492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 386/791] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:31.831741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.922380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:31.962057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:31.972596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837048-7d1f-4c77-87c6-d364aace67dc None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:31.984509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.012168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.013142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.013724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.014210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.015246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:32.015761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.017590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.036841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 406/792] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:32.046938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.064071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1f8c-6ccb-4b0b-9583-2d7d66eefa42 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.099140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.099736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.100018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.100986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.112286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:32.118319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:32.119295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:32.120152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 387/793] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:32.125251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.211191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92681505-31c9-4e80-bb42-d7a1cfae9479 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.225994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.235776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae58bb-1ee3-491f-ba9c-6948cb1d10e8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.253015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.254021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.254602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.255122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.267010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.268902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.273605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.274217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.274495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.274765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.275465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:32.275769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.277128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.280976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.287222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 388/794] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:32.289827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:32.290195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:32.291323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:32.292347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:32.292347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:32.292347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:32.298227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 407/795] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:32.298227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.418479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d30908-ef88-40a9-b1d0-9922aef2a529 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.456365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.457318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.457754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.458171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.470201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:32.476619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:32.477617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:32.478464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:32.485083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 389/796] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:32.486065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.504137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.538130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca0d1-11a9-46f2-8529-1bb499b03cdc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.575957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.576659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.576873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.577153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.588193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.589658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.600092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30645-bb45-4faa-bd19-b9411b367240 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:32.605657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:32.606790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:32.607791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:32.607791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:32.607791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:32.607791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 408/797] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:32.608034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.644346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.645368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.645862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.646421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.647740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:32.648327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.650072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.662507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.665358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 390/798] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:32.666583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.713726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fea57-5068-4042-ac19-bb5866ef8d84 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.749911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.749911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.750162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.750444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.751158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:32.751474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.752862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.756037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.768101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 409/799] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:32.768101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.792676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d65de-8048-4f3a-ad52-b908d070b88a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.831926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.832564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.833014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.833300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.833970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:32.834360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.838412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.852458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 391/800] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:32.852458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:32.892740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd8e6a-6b46-4ce4-b0fd-1093a4b78f08 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:32.909656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.933863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:32.934502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.934780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.935080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.942684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:32.944445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0ccc6170-2b42-4239-b229-9b5c9f185e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:32.956853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:32.957837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:32.958732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:32.963316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 410/801] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:32.964469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164fbb-0512-4cbb-986f-02b65be38d2a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:32.964754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164fbb-0512-4cbb-986f-02b65be38d2a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:32.965026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164fbb-0512-4cbb-986f-02b65be38d2a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:32.970758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 411/802] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:32.970758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d164fbb-0512-4cbb-986f-02b65be38d2a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.073279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ff9a-43bf-421d-b24b-91aa2c6090e7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.079175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d164fbb-0512-4cbb-986f-02b65be38d2a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.109735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.110458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.110736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.111028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.112894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.115817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.117179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.117456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.117729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.123765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.125202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.126635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.128571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:33.139641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:33.140587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:33.146769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:33.146769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:33.146769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:33.146769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 392/803] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ee035dbb-c3d5-43b0-b8d1-61645a5a1f80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:33.147701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:33.149359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:33.150306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:33.150851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.150921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 412/804] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:33.150921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.150921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.150921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.168353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:33.170000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:33.201033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.248124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 413/805] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:33.248975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.291730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da8207-fb6f-463d-8915-6b35a6011ae6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.340253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.341706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.342189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.342914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.344087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:33.344995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.347217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.354764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cce4ce-504a-48ab-a687-c9fe651c28f4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.364471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 393/806] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:33.365583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.401061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.402627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.403075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.403509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.404286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:33.404730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.406242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.414010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.426125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 414/807] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:33.426125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.459360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.478712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adf57a-7b54-4b1f-bb10-b95d78d5791f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.524700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.525282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.525674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.526040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.526967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:33.527390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.528917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.552009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4848e0-7cd5-4f74-b4df-25900f949a0a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.554046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 394/808] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:33.556118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.594095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.595233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.595752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.596167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/72c7ab7c53954787bbd3970c139ceb56/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.599162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=72c7ab7c53954787bbd3970c139ceb56, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.601282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.618448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 415/809] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:33 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/72c7ab7c53954787bbd3970c139ceb56/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:33.619590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.677578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276c73-a22d-4240-8af7-2af575fe8c81 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.681927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.737102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.755289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.756084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.757019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.758191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.762303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fb004-f093-4a2c-8171-ab788977d0f8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.776169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.777645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.803243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.804464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.804947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:33.805372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:33.806291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 395/810] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:33.811477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.812118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.827318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.828922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:33.845216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:33.846182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:33.847107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:33.847107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:33.847107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:33.852741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 416/811] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:33.853681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:33.953961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819881d-327b-4974-a463-02c7bd45bacd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:33.990057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:33.991599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:33.992206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:33.992477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] PATH_INFO: `/v3/services/network` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:33.993065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:33.994432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:33.997693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9dfdd-2d56-4600-be68-82fd053b0966 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:34.004939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:34.006002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 16:04:34.007664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.009660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 396/812] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:34.010589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.037416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.038292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.038718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.039189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.040017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.040149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:34.040377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.041808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b742-e51b-4ebb-aa0e-6977ed233023 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.045753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 417/813] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:04:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182045-a5fd-4347-90e2-a2c0019af92e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182045-a5fd-4347-90e2-a2c0019af92e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182045-a5fd-4347-90e2-a2c0019af92e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 418/814] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:34.065982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182045-a5fd-4347-90e2-a2c0019af92e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.125263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057cf52-fac1-4818-9dcd-1db7e5f5bb77 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.159879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.160485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.160770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.161042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.161680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:34.161983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.163433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.174789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 397/815] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:34.175619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.183363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182045-a5fd-4347-90e2-a2c0019af92e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.221419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.222375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.222848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.223401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.224083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] RBAC: Adding query filter params (name=network) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:34.224388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.226007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303396f-90d6-4ac6-870b-50c8e19d2a70 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.235236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 419/816] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:34.235236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.235236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.235236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.254946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:34.256164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:34.277114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.290436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a8d3-ff49-4b0d-9ec6-04d1d8fc5a8a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.312963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.326547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.327244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.327482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.327756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.335364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 420/817] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:34.335364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.432973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.435653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.440622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a838-16a0-4b34-9a92-37577670e8e5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.476585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.477296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.477644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.478009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.485054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.486580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:34.502759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:34.503795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:34.504726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 421/818] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:34.505228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.555264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.557335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.575534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 398/819] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:34.576765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.621692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1a9c1-28a4-46c6-9c31-d6565cec52c8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.660936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.661546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.661826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.662099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.662771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] RBAC: Adding query filter params (type=network) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:34.663434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.664688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.669793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 422/820] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:34.670676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.689773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d8812-a490-4d54-a07e-57467bf7328c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.726715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.727415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.727691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.727961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.728646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:34.728948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.730366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.747782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 399/821] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:34.747782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.784886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ccb4-628e-4da8-aa84-1331763c5efa None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.793548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.801822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:34.824462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.825084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.825364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.825835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.839102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.840598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.856535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f7e0-e13f-4fb9-8b8d-d4bc1d8e505b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:34.859788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:34.860740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:34.867588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:34.867588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:34.867588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:34.867588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 423/822] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:34.867588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.897890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:34.899076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:34.899582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:34.900049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:34.900959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:34.902646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:34.913473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:34.914568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 16:04:34.915437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:34.917638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 400/823] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Aug 30 16:04:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:34.917638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:34.974820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266c4-74e3-4b10-9b45-f8d3efdae383 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.012285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.013107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.013543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.013967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.014763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.016316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.020814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4f0e-56a1-441c-9e5a-eec3d02f2e8b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.035944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.040484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 424/824] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:35.041772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.075337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.080222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.081174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.081646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.082061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/ea26d0ce8e3540289d31c4981db0596a/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.102863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=ea26d0ce8e3540289d31c4981db0596a, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.104787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.121659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 401/825] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:34 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/ea26d0ce8e3540289d31c4981db0596a/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:35.122916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.185498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63ddcd-bf87-402e-a457-d74f9fac6eac None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.230829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.231408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.231685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.231959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.233306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:35.233306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.234671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.251066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 425/826] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:35.252055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9f79-5616-4ec5-826e-fa2a80749461 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.256098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.300891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.301524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.301804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.302078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.302780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:35.303137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.304702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.314426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 402/827] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:35.315875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.349067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.372146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.397997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d6ba-ab61-43b7-98a1-6ebd6b4c4b22 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.438324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.439045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.439332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.439603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.450312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.451209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e262-46d1-444f-b156-bd4efc02c642 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.451855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:35.465190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:35.466387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:35.467462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 426/828] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:35.473577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.500259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.501121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.501563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.503194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.504282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:35.505011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.507995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.515833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 403/829] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:35.521640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.619434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4168-c369-4cf2-8755-96d048a7aa87 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.632981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.653844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35816a33-5c6e-4f2e-8088-dfeba7fa711d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.662062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.662778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.663099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.663374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.664082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:35.664818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.666323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.678725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.684339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 427/830] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:35.689860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:35.702612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.703740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.704229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.704902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.706250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.708359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a7be4-baed-466e-ba20-593640c1cb30 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.735983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 404/831] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:35.768016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b5f1-e0ed-4f26-be8c-6f3c8406d7ae None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.768855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b5f1-e0ed-4f26-be8c-6f3c8406d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.769361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b5f1-e0ed-4f26-be8c-6f3c8406d7ae None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.771314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 405/832] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:35.780877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.781565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.782131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.805782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16355-b9ff-4f0e-95e8-7e5058e0dfac None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:35.806279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:35.808072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:35.851025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:35.851025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:35.851344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:35.851592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:35.853534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:35.853534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:35.854013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:35.861027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 428/833] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:35 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:35.906110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 406/834] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:36.179447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:36.241690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:36.284845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de19e-01de-499d-b6d4-2fce523d6fb2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:36.320194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:36.320825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:36.321108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:36.321382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:36.332057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:36.338214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:36.339194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:36.340062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 429/835] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:36.345536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:36.420712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:36.452631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1147f2-d757-4886-93db-c02b4fdbcc91 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:36.487917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:36.488535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:36.488816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:36.489088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:36.490013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:36.490316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:36.492231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:36.500619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 407/836] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:36.506084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:36.608458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b08b07-f058-4c38-b8bb-3a01d1b32060 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:36.631925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:36.643875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:36.644513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:36.644830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:36.645121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:36.656182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:36.657663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:36.672966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:36.673933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:36.674850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:36.674850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:36.674850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:36.674850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 430/837] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:36.680550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:36.784284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffcb5-bc6d-430d-a8b0-6474eeff8429 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:36.820534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:36.821257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:36.821549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:36.821832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:36.822495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:36.822806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:36.824280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:36.827315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:36.838388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 408/838] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:36.846848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:36.952319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdaeee-984d-4c16-b2c0-f32ea6c91f24 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:36.987164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:36.987793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:36.988071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:36.988342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:36.998161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:36.999713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:37.011567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:37.012506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:37.013535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 431/839] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:04:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:37.018589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.125509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989770-3b4e-4433-89c7-03626d34174c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.159535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.160141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.160424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.160698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.161423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:37.161729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:37.163974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b2c1-0c62-4fe7-b430-6a7a778c8454 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.181973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 409/840] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:37.187555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.231003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:37.243610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf1ba-644f-4bc9-abd3-d3e0bd955b10 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.243900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf1ba-644f-4bc9-abd3-d3e0bd955b10 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.244240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf1ba-644f-4bc9-abd3-d3e0bd955b10 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.245815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 410/841] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:37.251739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.252022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.252296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.273580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:37.274878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:37.314773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9d7-2b4b-4317-af3f-9a1d96be4cca None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.327203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:37.353604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.354160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 411/842] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:37.354599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.354599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.354821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.429356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:37.430756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.462964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:37.534294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 432/843] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:37.540053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.621226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.654519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a08bf-b292-4949-a5ca-0f1e9d587c33 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.690575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.691738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.692021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.692296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.704260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:37.705357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:37.720594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:37.721587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:37.722495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:37.722495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:37.722495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:37.722495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 412/844] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:37.727794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.742252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf63c79-4bb8-4ec6-825b-00f57f75aa51 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.779841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:37.785537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.786414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.787313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.788352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.795477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:37.801993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-17a00317-6cb8-44ed-a632-8d4f437e0fde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:37.808526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:37.809633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:04:37.810655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:37.813730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 433/845] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:37.815285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97264f-df17-4e1c-bb6e-502b08830a3a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.815855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97264f-df17-4e1c-bb6e-502b08830a3a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.816134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97264f-df17-4e1c-bb6e-502b08830a3a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.817969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 434/846] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:37.822469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97264f-df17-4e1c-bb6e-502b08830a3a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:37.848392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788693f2-acb2-4142-916c-d5fe0608b48a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.891576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.892734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.893465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.894331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.895486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:37.896002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:37.898727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1a0ee-2513-46cd-8db7-12cbd1585c2b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.911471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 413/847] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:37.913513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dcc7-dc31-48f2-addc-3cdf061ba622 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.913848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dcc7-dc31-48f2-addc-3cdf061ba622 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.914125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dcc7-dc31-48f2-addc-3cdf061ba622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.931515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6c21dcc7-dc31-48f2-addc-3cdf061ba622 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:37.932791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6c21dcc7-dc31-48f2-addc-3cdf061ba622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:37.939198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97264f-df17-4e1c-bb6e-502b08830a3a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:37.973101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:37.973703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:37.973984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:37.974257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:37.974915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:37.975990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:37.977388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:37.985596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 435/848] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:37.986381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.000890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 414/849] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:38.002204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58522785-8650-4dbe-a0c3-399a9686fc79 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.002499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58522785-8650-4dbe-a0c3-399a9686fc79 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.002775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58522785-8650-4dbe-a0c3-399a9686fc79 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.007019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 415/850] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:38.007019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58522785-8650-4dbe-a0c3-399a9686fc79 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.037181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.052481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.100357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe997b-2030-4315-8ff3-7d9c7249e55b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.127499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58522785-8650-4dbe-a0c3-399a9686fc79 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.138520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.139187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.139472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.140054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.147867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.149305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-eaf7b464-5ea8-4b20-85b8-37afbdbbea1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:38.160476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:38.161372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:38.162364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 436/851] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:38.163754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.163754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.163754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.169772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.171023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.171023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.171023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.181530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:38.181785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.182714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:38.183271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:38.199177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:38.200163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:38.201950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:38.201950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:38.201950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:38.201950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 416/852] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:38.201950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.259876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 437/853] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:38.261137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.292495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.308054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.320254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc02377-60c6-4050-9727-0f077ff5315b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.354107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.354705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.355266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.355266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.355936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:38.356235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.358021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.369786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9626bdd-31c1-4a16-b174-f7b71a9048d8 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.370693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 417/854] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:38.371527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.409265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.409868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.410150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.410417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.411075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:38.411377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.412817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.424550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 438/855] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:38.425324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.481135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ffbb-0abd-4d84-a08f-8df647349595 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.516673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.517220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.517498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.517767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.518343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.519719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.523310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:38.530633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:38.531878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:38.532927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 418/856] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:38.533877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.536667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875fbc7-659c-4510-96db-e7167199681d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.539242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.571963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.572566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.572846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.573122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.573844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=72c7ab7c53954787bbd3970c139ceb56) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:38.574157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.575630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.581861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 439/857] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/role_assignments?user.id=72c7ab7c53954787bbd3970c139ceb56&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:38.582633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.649369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba0b2-2c17-4516-84a2-9582f3ef6ce8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.689530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.690184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.690465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.690737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.694703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7efe-3e68-4e5f-9e90-0bc5a371e101 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.699619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.701093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:38.714341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:38.715400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:38.716355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 419/858] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:38.716945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.740417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.741055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.741339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.741615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.742207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.743625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:38.752582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:38.753519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:38.754719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 440/859] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:38.755926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.791324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.793311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:38.836662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a0bf-9594-4a1c-8b6c-c46dbfa6a165 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.872796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.873409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.873688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.873954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.874571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:38.874878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.875827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1553f-7e48-4a21-98e3-15902fd7f36e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:38.876285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.886327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 420/860] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:38.887255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.917309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:38.917919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:38.918196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:38.918464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:38.919207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:38.919507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:38.920930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:38.943139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 441/861] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:38.943139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:38.998641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c83d-0141-42a0-9278-5b64f06ab1cd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.023125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.034894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.035551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.035834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.036107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.036746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:39.037042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.037154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.039162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.044027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 421/862] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:39.044761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.054819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b261-33c4-4df7-951c-d5ced0d04bb4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.095518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.096367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.096815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.097242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.097861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:39.098354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.099579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.105102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 442/863] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:39.105704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.185749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22efb7-c9a4-49df-ad40-1b837aff5000 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.222462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a131-3f69-4b55-9506-f4eb0d237daf None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.237245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.238518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.239809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.240301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.264938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.265554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.265886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.266717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.266907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:39.267228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.268611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.274521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 443/864] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:39.321756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.336923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.338485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.451081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 422/865] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:39.454147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.479993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.563200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0ebe-06c2-4e29-a37f-64014732f48b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.600091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.601237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.601718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.602182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.612974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.615051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:39.630725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:39.632425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:39.633347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:39.633347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:39.633347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:39.635493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 444/866] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:39.642959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.733986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.747433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41e82-ddf5-4b90-ae33-30794e5f8e80 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.783209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.784183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.784666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.785162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.786172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:39.786687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.788895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.801623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 423/867] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:39.807046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:39.887607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.919765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b180ab-6c5c-453a-a4a3-dd9194b6abc1 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:39.953767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:39.954391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:39.955014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:39.955291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:39.962468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:39.963944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:39.975720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:39.976640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:39.977544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 445/868] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:39.982808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:40.086009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4a1e-5daa-43e6-a75f-053ec151d28e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:40.120865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:40.121511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:40.121793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:40.122068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:40.122759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:40.123087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:40.124523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c115f-cf95-466a-8b54-81ef5fb49f8f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:40.141602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 424/869] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:40.147885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:40.251415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db8ca-9240-4c2d-b28c-1833ba9f6ba6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:40.281257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:40.287864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:40.288442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:40.288685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:40.288958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:40.289982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=ea26d0ce8e3540289d31c4981db0596a) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:40.290292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:40.291799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037337fd-5581-418f-a298-d02b17465c0a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:40.298496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 446/870] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:40 2022] GET /identity/v3/role_assignments?user.id=ea26d0ce8e3540289d31c4981db0596a&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:40.615060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78758-44c7-4d44-be13-7a1f3ccf0df6 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:40.615578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78758-44c7-4d44-be13-7a1f3ccf0df6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:40.615752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78758-44c7-4d44-be13-7a1f3ccf0df6 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:40.617425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 425/871] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:40.622715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:40.623138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:40.623310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:40.642011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:40.643215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:40.712385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 447/872] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:40.979205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d78758-44c7-4d44-be13-7a1f3ccf0df6 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:40.990303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:41.091015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d78758-44c7-4d44-be13-7a1f3ccf0df6 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:41.127540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:41.128175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.128458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.128735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.129329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:41.130692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c0059038-1a27-4144-bbda-37d930067812 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:41.140436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:41.141431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:41.142303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 426/873] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:41.148027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:41.154801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8bf09-e6af-47de-a518-ca66733f3e58 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.155118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8bf09-e6af-47de-a518-ca66733f3e58 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.155396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8bf09-e6af-47de-a518-ca66733f3e58 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.157006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 427/874] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:41.161742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cae46-db6f-405c-a1a8-1c1df93bfa0c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.162079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cae46-db6f-405c-a1a8-1c1df93bfa0c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.162360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cae46-db6f-405c-a1a8-1c1df93bfa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.184781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-dc6cae46-db6f-405c-a1a8-1c1df93bfa0c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:41.186035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dc6cae46-db6f-405c-a1a8-1c1df93bfa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:41.267378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 428/875] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:41.267552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855070-3140-4d41-a541-79a5ebae27b8 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:41.297450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:41.300769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26e02-5575-438d-b97b-c24233761d62 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.301781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26e02-5575-438d-b97b-c24233761d62 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.302724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c26e02-5575-438d-b97b-c24233761d62 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.309149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 429/876] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:41.310073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:41.310683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.310966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.311272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.311576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.311907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:41.312213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:41.312473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.313067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.313743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:41.319067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 448/877] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:41.320719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:41.327431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:41.334650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:41.336236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:41.419331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 430/878] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:41.451276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359e24-7719-438e-8038-71efd0303091 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:41.488365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:41.488992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.489274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.489805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.490460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:41.491467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:41.493178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:41.499104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 449/879] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:41.604710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:41.695741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:41.726345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225602-868c-49b2-b540-4a9b89cb9771 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:41.758096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:41.764374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:41.765236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.765668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.766091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.766929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:41.768701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389690-4c03-474b-ad19-5e0de8d2ee56 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:41.773750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:41.788815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 431/880] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:41 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:41.849915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15cb35-968c-4bf6-93a2-3ee2029002ac None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:41.896146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:41.896706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:41.897066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:41.897318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:41.897987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:41.899448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec82a6-6900-4bb8-90e7-c4ff77cdef54 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:41.918160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 450/881] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:41 2022] POST /identity/v3/services => generated 269 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:42.386080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5699-2bda-4930-b9d1-494a4101ac12 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:42.386415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5699-2bda-4930-b9d1-494a4101ac12 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:42.386769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5699-2bda-4930-b9d1-494a4101ac12 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:42.388429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 432/882] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:42.393711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:42.394007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:42.394290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:42.413308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:42.414600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:42.496760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 451/883] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:42.765541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5699-2bda-4930-b9d1-494a4101ac12 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:42.874503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5699-2bda-4930-b9d1-494a4101ac12 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:42.910500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:42.911165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:42.911463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:42.911779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:42.923018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:42.927809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:42.929320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:42.930210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 433/884] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:04:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:42.935510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:42.972939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.047087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201824d2-1e0a-4727-9ae6-e21a40628178 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.084136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.085289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.085570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.085931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.086619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:43.086926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:43.088342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:43.101858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 452/885] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:04:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:43.104066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:43.158170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.208648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003e4d5-d4bf-4582-b262-ea88c28ff970 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.247809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.248452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.248737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.249013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.260015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:43.261473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:43.277237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:43.279465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:43.281559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:43.281559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:43.281559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:43.281559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 434/886] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:43.284258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:43.384097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.389937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd7ef-658c-4411-81b8-e62e55ced040 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.426573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.427210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.427492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.427768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.428481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:43.428797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:43.430159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c86e-ef75-4e6d-9f67-54736348375e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:43.447115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 453/887] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:43.449209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:43.559612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed0f5a-bdd0-4e3d-8ec8-f6351bd1e0fa None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.563014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.599373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb518-973f-44b5-9157-c93ba30eb2ac None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.599373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb518-973f-44b5-9157-c93ba30eb2ac None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.599373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb518-973f-44b5-9157-c93ba30eb2ac None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.603183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 454/888] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:43.606383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.606673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.606843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.607039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.607365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.607822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.608107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.617699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:43.619197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:43.626573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:43.627823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:43.631056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:43.633619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:43.634900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 435/889] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:43.640199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:43.715166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 455/890] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:43.747780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131878-b1e7-4b56-99c3-2982df588a57 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.783945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.784713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.784893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.785060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.785804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:43.786110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:43.787858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6774f9-3f7e-4990-be00-a43d35e3dc71 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:43.806938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 436/891] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:43.812515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:43.904563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.913563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066710d-3ae5-4e7a-a154-a2f89d7b93a7 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.914234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066710d-3ae5-4e7a-a154-a2f89d7b93a7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.914810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066710d-3ae5-4e7a-a154-a2f89d7b93a7 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.916721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 437/892] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:43.921667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baff-a071-480c-b1be-0a339cca01cb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.921948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baff-a071-480c-b1be-0a339cca01cb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.922300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baff-a071-480c-b1be-0a339cca01cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.925918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e652bb-dfb8-4b37-a7c8-f42b11f31cc6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:43.942024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-8c36baff-a071-480c-b1be-0a339cca01cb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:43.944237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8c36baff-a071-480c-b1be-0a339cca01cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:43.960822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:43.961433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:43.961696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:43.961968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:43.967844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.023715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 438/893] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:44.024962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375660-826e-4b1a-840e-95f9a7e5618a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.025446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375660-826e-4b1a-840e-95f9a7e5618a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.025563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375660-826e-4b1a-840e-95f9a7e5618a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.026731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 439/894] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:44.027411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375660-826e-4b1a-840e-95f9a7e5618a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.044203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.045761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f89d7-c98f-4805-ba05-ce2fd3abbd49 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.132678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.136387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375660-826e-4b1a-840e-95f9a7e5618a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.154235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 456/895] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 16:04:44.154235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.154235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.154235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.169551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:44.170655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:44.177969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.178749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.179051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.179326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.179975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.181329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.207015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 440/896] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:44 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:44.207015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.227467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.259169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 457/897] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:44.295997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.343624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf01df-2a80-4ed7-8f4d-b1fcdb56d875 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.383806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.384038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.384307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.384668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.398916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.400319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:44.415975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:44.416961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:44.418495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:44.418495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:44.418495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:44.418495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 441/898] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:44.422776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.431455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd790ac4-3598-4c1b-8a13-f7bf5a1187cf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.447375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.468067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.468891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.469169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.469490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.470083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.471744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:44.481156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:44.482131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:44.483206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 458/899] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:44.488674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.510039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.557351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a70-63fd-4754-96da-efab8d3f8d7a None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.594661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.595302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.595579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.595852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.596507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:44.596824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.598154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.610029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 442/900] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:44.610826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.618226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18497fd-e832-4906-aa48-d9389f44ec3b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.656340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.657286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.657737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.658237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.659100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:44.659412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.660913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.670620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 459/901] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:44.670620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.714737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.719435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533577c7-d66f-4cb4-ab27-ef6f91f89ff3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.746760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.759664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.760403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.760751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.761032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.761625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.763014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:44.773110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:44.774099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:44.774949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 443/902] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:44.775775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.780233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd395c-93ed-4755-a829-ae39dd9ca453 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.822844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.823507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.823787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.824508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.832611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.834077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:44.852155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:44.853085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:44.853998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:44.855864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 460/903] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:44.857019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.894666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68a9a5-5efe-48a1-96fe-119660d80022 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.930239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:44.930847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:44.931165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:44.931441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:44.932086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:44.932382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:44.933757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:44.938675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 444/904] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:44.939481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:44.968477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.972199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f28e-0752-4286-ae02-c8654aca921d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:44.995701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.011658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.012269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.012553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.012823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.013457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.013761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.015179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.020246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 461/905] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.020853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.050220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c93ef5-933b-4249-9bce-95f46475d7f6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.088391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.088996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.089264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.089538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.090229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.090525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.091991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.104394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 445/906] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.105159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.137240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231d53-620f-4061-8113-063df72e4161 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.172291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.173025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.173307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.173579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.174265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] RBAC: Adding query filter params (interface=public, service_id=f5e374d6c6d94c43aab9003d196ee3e0, region_id=RegionOne) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.174576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.176100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.181908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 462/907] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/endpoints?service_id=f5e374d6c6d94c43aab9003d196ee3e0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.182680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.213464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.213641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66962-3a9b-40b5-b73b-4274fbfe76a4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.228812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.255025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.255025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.255025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.255025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.255530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.255530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.255885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.261261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 446/908] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.262339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.297300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36ba0-ed2b-466d-8f8e-526de178d75d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.331053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.331660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.331955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.332212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.332927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] RBAC: Adding query filter params (role.id=671f67c430b64ebeab42232a598fb03c, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=ea26d0ce8e3540289d31c4981db0596a) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.333239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.335257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.340576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 463/909] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/role_assignments?user.id=ea26d0ce8e3540289d31c4981db0596a&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=671f67c430b64ebeab42232a598fb03c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.341354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.390474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a812d-c3c1-483e-aba2-3f6dafdf2974 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.432466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.433552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.434024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.434640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.435516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.437145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.444753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 447/910] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:45.469905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.480860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865091-25f6-448a-afdf-ef45a4696d88 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.524635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.525258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.525540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.525818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.526536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] RBAC: Adding query filter params (interface=public, service_id=9499cad293c6406a8b6d2e4382d0fddc, region_id=RegionOne) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:45.526848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.528336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974715-9c61-4271-a10a-8b5f93f79f00 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.534329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 464/911] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/endpoints?service_id=9499cad293c6406a8b6d2e4382d0fddc&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:45.540950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:45.589238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.658173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49167fb-2c0d-4593-b2ec-639baad16ce3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:45.693922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:45.694531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:45.694811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:45.695151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:45.695760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:45.697189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a0256-019c-4f92-a9da-9180678d89ba None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:45.703580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 448/912] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:45 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:46.241827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe7da-63e9-4f17-8375-f7028b3e7895 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:46.241827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe7da-63e9-4f17-8375-f7028b3e7895 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:46.241827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe7da-63e9-4f17-8375-f7028b3e7895 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:46.243092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 465/913] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:46.248513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:46.249314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:46.249807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:46.268312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:46.269780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:46.347157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 449/914] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:46.615149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe7da-63e9-4f17-8375-f7028b3e7895 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:46.718966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe7da-63e9-4f17-8375-f7028b3e7895 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:46.753928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:46.754560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:46.754841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:46.755147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:46.755733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:46.757139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:46.765984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:46.767103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:46.768219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 466/915] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:46.776256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:46.815082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:46.886697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87654e-3486-4d30-835c-02d679bf85a9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:46.921689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:46.922668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:46.923189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:46.923677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:46.924532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:46.925049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:46.926641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:46.937158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 450/916] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:46.938786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:46.963394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:47.042442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905e2b-e78e-43e3-ba4f-9720908a47dc None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:47.079037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:47.079651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.079932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.080207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.080841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:47.081143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:47.082520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:47.088110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 467/917] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:47.096332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:47.198273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:47.202099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492425-05bd-45d9-be41-7275c41a9b7f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:47.238157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:47.238813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.239127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.239403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.240370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] RBAC: Adding query filter params (interface=public, service_id=ae3fb1450f514506a48689a0bd97bb3d, region_id=RegionOne) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:47.241227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:47.242603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbd3ed-a065-486d-a34f-cb32132201c2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:47.252424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 451/918] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:47 2022] GET /identity/v3/endpoints?service_id=ae3fb1450f514506a48689a0bd97bb3d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:47.254040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:47.345579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:47.362216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb427-5544-443b-9da2-32df68912f6f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:47.398699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:47.399343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.399624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.399893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.400494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:47.401934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9fab4-e71e-4322-b38f-fccf1a2f5032 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:47.408390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 468/919] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:47 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:04:47.418564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186b1b-3871-4762-a93e-44d920b81278 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.419259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186b1b-3871-4762-a93e-44d920b81278 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.419774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186b1b-3871-4762-a93e-44d920b81278 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.421832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 452/920] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:47.427870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500aa0-e548-4f89-9ff9-c0c75811ce77 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.429090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500aa0-e548-4f89-9ff9-c0c75811ce77 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.429583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500aa0-e548-4f89-9ff9-c0c75811ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.431481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2fbc-2358-4598-a737-2044af5fbde0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.431755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2fbc-2358-4598-a737-2044af5fbde0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.432035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2fbc-2358-4598-a737-2044af5fbde0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.433792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 453/921] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:47.443035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b6d3-70eb-4230-8af3-a31bb64cd94f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.443035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b6d3-70eb-4230-8af3-a31bb64cd94f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.443035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b6d3-70eb-4230-8af3-a31bb64cd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.451019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-01500aa0-e548-4f89-9ff9-c0c75811ce77 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:47.452233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-01500aa0-e548-4f89-9ff9-c0c75811ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:47.461009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1420b6d3-70eb-4230-8af3-a31bb64cd94f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:47.462725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1420b6d3-70eb-4230-8af3-a31bb64cd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:47.531057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 469/922] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:47.563006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 454/923] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:47.720511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cf1d-b0ba-466a-9829-0cbc543ea54e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.720832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cf1d-b0ba-466a-9829-0cbc543ea54e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.721092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cf1d-b0ba-466a-9829-0cbc543ea54e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.722708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 470/924] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:47.728957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.729251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.729528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.749151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:47.750357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:47.806416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6cf1d-b0ba-466a-9829-0cbc543ea54e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:47.823894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 455/925] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:47.857819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:47.884755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:47.897387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:47.920852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6cf1d-b0ba-466a-9829-0cbc543ea54e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:47.956163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:47.956786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:47.957063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:47.957330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:47.967675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:47.972014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c11ea-1dae-4c9e-82b6-243088aa65be None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:47.972390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:47.973509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:47.974745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 471/926] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:04:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:47.979799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.017231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.018216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.018733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.019249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.020108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.021805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:48.031455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:48.032405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 16:04:48.033303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:48.036014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 456/927] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Aug 30 16:04:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:48.043350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.089215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da8e0-7e38-418c-bd31-b94db2fad251 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.125000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.125602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.125878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.126150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.126805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.127135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.128517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.134701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.139050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 472/928] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:04:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:48.140070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.146759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.164708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9dd3-7ca1-43a2-a3a6-9c4bbfea364f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.201158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.201764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.202044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.202493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.202933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.203273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.204646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.216059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 457/929] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:48.216059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.244980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb391c-b821-42cf-80e4-12680d4e732f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.279786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.281073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.281356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.281634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.282217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.283620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:48.292682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:48.293697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 16:04:48.294550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:48.298815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 473/930] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:48.299611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.324306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138f5-94b4-40d5-94fb-a66377185cd8 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.360141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.360766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.361050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.361325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.365447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.375502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.376984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:48.395594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:48.396589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:48.398053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:48.398053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:48.398053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:48.398053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 458/931] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:48.398795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.401512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.408859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc38d6-44ba-4ce3-95fb-a1c18bc8f124 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.448865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.449573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.449766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.450005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.450627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.450924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.452318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.457777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 474/932] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:48.458390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.509927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acffe2-92ae-4393-9250-2ac73da8e611 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.546267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.546884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.547200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.547475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.548107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.548411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.549773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.554757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 459/933] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:48.560343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.565470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bede87-31c3-4dad-9a9a-ad529e5bb326 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.594257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.603128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.603741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.604021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.604292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.604993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.605302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.606665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.622792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 475/934] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:48.622792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.641185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.678807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bdd3a-4a5d-454f-a318-54c36fccd146 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.713823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.714426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.714706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.714999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.715669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.717029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.728366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5116-5c9f-4737-b21c-29db6ae3f2f6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.739464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 460/935] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:48.741750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.773513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.774115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.774396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.774671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.775408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:48.775717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.777149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.785361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 476/936] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:48.794164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:48.852871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.908667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe1f0-8e34-4261-b841-1b6dcf36f30e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.911125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb7ab-25f2-4e65-ab5d-674aedf55217 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:48.937165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.948037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.949276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.949276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.949276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.950389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.951246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.955946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:48.957022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:48.957835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:48.958114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:48.967811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:48.969527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:48.980012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 477/937] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:48.988517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:48.989841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:48.991388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 461/938] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:48.998747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.124045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:49.129440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202ca5-0b60-42bb-bef6-59a5f9b122c6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.167552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.168167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.168448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.168720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.169449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:49.169755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.171207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.190176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 478/939] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:49.197513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.306586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ff19e-13d1-42fc-bc43-e9a59bca37a1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.342950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.343611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.343867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.344144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.355867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.357327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f70a93df-e3f3-4d94-9361-12a08bf83fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:49.372819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:49.373833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:49.375471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:49.375471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:49.375471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:49.375471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 462/940] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:49.380077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.403196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fed7-9cfa-48a4-8882-663de0577c0e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.403518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fed7-9cfa-48a4-8882-663de0577c0e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.403755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fed7-9cfa-48a4-8882-663de0577c0e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.406112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 463/941] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:49.410505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.410786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.411111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.435929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:49.437194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:49.479372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:49.494845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa036-dae3-4316-8b22-bf31048dc985 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.530357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 464/942] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:49.540857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.541463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.541742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.542018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.542728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:49.543093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.544440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.556544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 479/943] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:49.562039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.662543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7776ae-53cd-4810-bcce-c6f0499da317 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.705683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.706369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.706658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.706931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.714450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.715988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:49.727617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:49.728524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:49.729451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 465/944] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:49.734873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.756012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:49.818216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.855551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:49.863691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8086-5ae8-42ed-86a0-8c6fc96a2912 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.908910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.909611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.909895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.910168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.910881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:49.911219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.912979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.931149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 480/945] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:49.935851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:49.948721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4ce6-32ca-4231-9443-20dc2d4ecb4e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:49.984994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:49.985959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:49.986443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:49.986919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:49.987763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:49.989346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:49.999406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:50.000424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:50.001264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:50.008858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 466/946] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:50.009946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:50.032346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:50.062639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac9ab-c1f0-4714-bfd6-73b9ea76fa1b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:50.109135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:50.109947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.110234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.110511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/ea26d0ce8e3540289d31c4981db0596a/roles/671f67c430b64ebeab42232a598fb03c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.113261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=ea26d0ce8e3540289d31c4981db0596a, role_id=671f67c430b64ebeab42232a598fb03c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:50.114966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:50.116336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:50.135060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 481/947] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:04:49 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/ea26d0ce8e3540289d31c4981db0596a/roles/671f67c430b64ebeab42232a598fb03c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:04:50.141727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd359d-4155-4919-a322-a78c9b118072 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:50.185118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:50.186146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.186651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.187246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.188134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:50.188707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:50.190436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:50.197450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 467/948] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:50.204661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:50.322626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231a0b6-db54-4869-8476-f9c372f9ccda None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:50.360518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:50.361138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.361421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.361757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.362394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:50.362704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:50.364188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33a96d-7814-4e0b-85a3-111bdff206cb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:50.370576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 482/949] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:50.376472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:50.482581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059acb1-fcb3-45b5-bd0e-69278c951b41 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:50.517887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:50.518504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.518782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.519082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.519767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:50.521131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8efb7-4338-4051-8bdf-de0ef10a3c18 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:50.543702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 468/950] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:50.790302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29b37-b416-46ba-86a7-c41c545fa409 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.791366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29b37-b416-46ba-86a7-c41c545fa409 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.791896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a29b37-b416-46ba-86a7-c41c545fa409 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.793724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 483/951] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:50.798817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d702ef-18f5-48f0-9990-a5ec234c1909 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:50.799140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d702ef-18f5-48f0-9990-a5ec234c1909 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:50.799429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d702ef-18f5-48f0-9990-a5ec234c1909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:50.817860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-39d702ef-18f5-48f0-9990-a5ec234c1909 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:50.819600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-39d702ef-18f5-48f0-9990-a5ec234c1909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:50.821665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:50.898967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 469/952] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:51.030229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fc67-5d52-4987-9cd0-0f12b22f7168 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.030574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fc67-5d52-4987-9cd0-0f12b22f7168 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.030782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fc67-5d52-4987-9cd0-0f12b22f7168 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.032565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 484/953] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:51.037912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.038331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.038691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.057447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:51.058650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:51.130619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 470/954] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:51.177468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405fc67-5d52-4987-9cd0-0f12b22f7168 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:51.181031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:51.295935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405fc67-5d52-4987-9cd0-0f12b22f7168 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:51.330334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:51.330885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.331188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.331459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.332029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:51.333403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:51.343181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:51.344169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.345638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 485/955] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:51.352412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:51.409262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:51.417860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:51.473705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44d3d1-e99a-463c-a8e2-250790b8895d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:51.494936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:51.522740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:51.523733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.524236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.524746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.526143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:51.526896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:51.529131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:51.536216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 471/956] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:51.543433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2c48-e783-435a-897c-a571a2cd78d8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:51.547981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:51.583664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:51.584255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.585615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.585615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.586437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:51.588248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:51.592289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING keystone.server.flask.common [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 16:04:51.617371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.sql.core [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 16:04:51.617371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 16:04:51.617371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [parameters: {'id': '3117d27f6375491aba388646e5117ca6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 16:04:51.617371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81608) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3117d27f6375491aba388646e5117ca6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3117d27f6375491aba388646e5117ca6. Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:51.639934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result.read() Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 16:04:51.640860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application yield resource Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise self.value Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application session.commit() Aug 30 16:04:51.641819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.session.flush() Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application compat.raise_( Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:04:51.642698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 16:04:51.644464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result.read() Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:51.645283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [parameters: {'id': '3117d27f6375491aba388646e5117ca6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.647798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:51.649742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3117d27f6375491aba388646e5117ca6. Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 486/957] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Aug 30 16:04:51 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:51.652029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:51.691097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e8c2-c127-4eb2-ab32-5708494a3974 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:51.732178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:51.741767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:51.742384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.742672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.742997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.743635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:51.743942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:51.745363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:51.751018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 472/958] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:51.796565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d37e0-778a-43c8-be6e-d9e2d57cfa6e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:51.823235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:51.845795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:51.846739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:51.847300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:51.847781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:51.861993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:51.864443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-755aef6f-c562-4df1-8d9c-24dabc21efc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:51.877797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:51.878776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:51.879842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:51.882930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 487/959] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:51.891140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.001400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71f75-5d47-4c8f-b9be-0bedb864f4f5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:52.036751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:52.037654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.038078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.038521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.039361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:52.039810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:52.041393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34b0e4-189a-4688-bba8-dfaf8343eebb None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:52.063095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 473/960] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:52.137034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e37a8-5ce2-47cc-9961-161b520d7c38 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.137545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e37a8-5ce2-47cc-9961-161b520d7c38 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.138034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e37a8-5ce2-47cc-9961-161b520d7c38 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.142880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 488/961] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:52.148109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf14-a94f-48fc-aab1-05d039251fb8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.148711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf14-a94f-48fc-aab1-05d039251fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.149209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf14-a94f-48fc-aab1-05d039251fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.168876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-555fdf14-a94f-48fc-aab1-05d039251fb8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:52.170443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-555fdf14-a94f-48fc-aab1-05d039251fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:52.225393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:52.249058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 474/962] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:52.514870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e37a8-5ce2-47cc-9961-161b520d7c38 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.605919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3206-9623-4421-9ea8-c8464d72440c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.606431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3206-9623-4421-9ea8-c8464d72440c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.606509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3206-9623-4421-9ea8-c8464d72440c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.608228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 475/963] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:52.613047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.613336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.613626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.632182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e37a8-5ce2-47cc-9961-161b520d7c38 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:52.632975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:52.634246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:52.678603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:52.680036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.680503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.681366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.698124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:04:52.705382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:52.706330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:04:52.707195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:52.708541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 489/965] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:04:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:52.711175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 476/965] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 30 16:04:52.713963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.762541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:52.821660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f03c6-50b7-4c3b-88b1-61a4f98338f2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:52.857536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:52.858145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:52.858426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:52.858700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:52.859397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:52.859702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:52.861083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:52.870736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 490/966] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:04:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:52.875998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.984542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939b3e-5153-4091-81a1-bbfadfc5cea2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:52.996885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:52.999869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.034339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.035569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.035979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.036258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.050433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.052458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:53.073343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:53.074296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:53.075226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:53.075226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:53.075226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:53.075226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 477/967] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:53.080285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.116973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8606366-90e8-497c-bef9-1446e6d1b9e6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.119477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.157954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.159340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.159713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.160091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.161038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.164163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:53.174889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:53.176117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:53.176996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 491/968] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:53.184200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.200793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e4815-7c0f-4288-bd34-2cfada056fec None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.237407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.238012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.238286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.238567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.239220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:53.239520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.241551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.259456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 478/969] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:53.260567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.288955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.305545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5d81a-6ebf-41a6-b4da-3fce4594c6f6 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.347627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.348619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.348900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.349175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.350264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:53.350845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.352532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.360368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 492/970] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:53.366153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.380379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3447ed6-c8df-48d0-aa34-8960321ae2ad None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.401070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.438132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.438761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.439059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.439336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.446879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.448390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:53.461465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:53.462462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 16:04:53.463849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:53.467577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 479/971] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:53.468403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.497194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955dcd1-dd60-455a-81d8-5089781fb75c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.545551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.546570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.547172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.547704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.548611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:53.549643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.551716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.559965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.560801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 493/972] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:53.565470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.583192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80311b-cc70-4fac-ba01-993407065c29 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.620428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.621038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.621301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.621485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.622207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:53.622555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.623962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.648913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 480/973] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:53.649831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.677401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.685608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aee88-7668-452f-b0a9-de7589fb9554 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.724278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.725793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.726739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.726739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.727418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] RBAC: Adding query filter params (interface=admin, service_id=ae3fb1450f514506a48689a0bd97bb3d, region_id=RegionOne) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:53.727827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.729312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.740386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 494/974] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/endpoints?service_id=ae3fb1450f514506a48689a0bd97bb3d&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:53.742154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:53.769387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63413-0e07-4563-af5e-c000dcfa5156 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.813670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.814562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.815023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.815464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.828358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.868730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053567a8-d000-4697-81f6-afaeefba3bfe None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:53.893016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.894715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.905321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:53.905932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.906211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.906487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.907120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:53.908495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99041-9455-4900-82f5-01eff350ec86 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:53.914667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 495/975] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:04:53.915909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d51-8735-4ee6-b83c-ca4e08a74ae0 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.916197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d51-8735-4ee6-b83c-ca4e08a74ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.916471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d51-8735-4ee6-b83c-ca4e08a74ae0 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.917829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 496/976] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:53.923283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902274fd-2671-49db-803f-d6bb1ad1868f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:53.923573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902274fd-2671-49db-803f-d6bb1ad1868f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:53.923847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902274fd-2671-49db-803f-d6bb1ad1868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:53.942874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-902274fd-2671-49db-803f-d6bb1ad1868f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:53.945014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-902274fd-2671-49db-803f-d6bb1ad1868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:53.964832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.034662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 481/977] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:04:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:54.038662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 497/978] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:54.044469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.094100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.151206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c3ff-70a2-4198-ac6e-78404d3578ac None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.151390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c3ff-70a2-4198-ac6e-78404d3578ac None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.151666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c3ff-70a2-4198-ac6e-78404d3578ac None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.154211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 498/979] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:54.155844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29923-b63e-44b1-bea7-d631dfdedd64 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.158119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.158400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.158673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.177537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:54.179778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:54.196096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.196746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.197278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.197565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.211362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.213236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:04:54.235875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:54.236888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:04:54.237810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:04:54.237810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:04:54.237810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:54.237810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 482/980] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:54.243711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.268037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 499/981] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:54.317428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.352758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3086c0-aa2b-4ab2-a4d3-782891972536 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.355285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.389547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.390477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.391064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.391533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.392460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:54.392939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.394594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.413963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 483/982] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:54.415264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.423477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.444262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969fc5-f03e-4adb-bf66-481617382842 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.491434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.492048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.492332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.492609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.493266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.495348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.523469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 500/983] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:54 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:54.538367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc3fd-66b1-411c-a169-7faf45cf31b7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.543138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.594319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.595009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.595284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.595554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.605759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.607369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:04:54.620938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:54.622349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:04:54.623268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:54.627397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 484/984] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:54.628757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.644437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.687043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9601e-dad6-4efa-ad96-8b9c3229fb8a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.743007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.743007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.743007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.743007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.743453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.743453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.751597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df741d-9ec4-4b1e-8db4-ee36fb6c1232 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.758428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.sql.core [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 16:04:54.758428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 16:04:54.758428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [parameters: {'user_id': 'f54f19e1cb8a45f9b90608fd053ee33b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 16:04:54.758428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81608) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result.read() Aug 30 16:04:54.766950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:04:54.767857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application yield resource Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application next(self.gen) Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise self.value Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application session.commit() Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 16:04:54.768845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.session.flush() Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application compat.raise_( Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:04:54.769760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:54.770650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application conn.query(q) Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application result.read() Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:54.773567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f54f19e1cb8a45f9b90608fd053ee33b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:54.775625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 16:04:54.777474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 501/985] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Aug 30 16:04:54 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:54.778969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.786444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.797972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.798881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.799653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.800119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.801309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:54.801770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.804135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.822969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 485/986] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:54.830548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:54.915971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b0c-0ac2-48a4-8deb-694e43af158d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.916673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:54.952696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1c235-93d0-4dcf-b27c-e3af469fa2d7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:54.960005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:54.960664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:54.960947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:54.961223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:54.971379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:54.973089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:04:54.988616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:54.989607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 16:04:54.991401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:54.994198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 502/987] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:55.000059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:55.001679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:55.002373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:55.002723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:55.003101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:55.003902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] RBAC: Adding query filter params (role.id=671f67c430b64ebeab42232a598fb03c, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=ea26d0ce8e3540289d31c4981db0596a) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:55.004285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:55.005801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3855d-edd2-49f5-9b66-8c8931d99560 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:55.021787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 486/988] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/role_assignments?user.id=ea26d0ce8e3540289d31c4981db0596a&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=671f67c430b64ebeab42232a598fb03c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:55.086718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:55.122135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22ca5-0d47-480d-9034-cefb8a2cd228 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:55.159468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:55.160089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:55.160373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:55.160653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:55.161364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:55.161670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:55.163262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda00a3-7ecf-496a-8e46-14a3eb78177c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:55.202494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 503/989] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Aug 30 16:04:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:55.968109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79725-e209-44c7-a954-192a54338050 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:55.968644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79725-e209-44c7-a954-192a54338050 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:55.968644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79725-e209-44c7-a954-192a54338050 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:55.970143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 487/990] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:55.975216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:55.975680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:55.975856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:55.996161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:55.997684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.067656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 504/991] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:56.335280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac79725-e209-44c7-a954-192a54338050 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.438116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac79725-e209-44c7-a954-192a54338050 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.472382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.473018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.473300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.473571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.474156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.475624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.477486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-73e49fd7-a606-46df-9047-a2423d158ab9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:56.486070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:56.487127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 16:04:56.487978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:56.489595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 488/992] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Aug 30 16:04:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:04:56.493943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.512616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0c77-a63c-4b25-9b3d-2c562f84eb3e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.512909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0c77-a63c-4b25-9b3d-2c562f84eb3e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.513175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0c77-a63c-4b25-9b3d-2c562f84eb3e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.514630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 489/993] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:56.519246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.519551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.519799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.539399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:56.540747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:56.551023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.597907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c025b-b43c-40bf-80f5-cd64d5c9018e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.611708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 490/994] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:56.633291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.633907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.634192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.634470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.635131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:56.635441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.636824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.646342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 505/995] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:56.648623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.750578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5079-9317-4ca5-9bff-def311904e9b None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.778111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.786731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.787932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.788221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.788494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.789180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:56.789487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.791043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.796351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 491/996] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Aug 30 16:04:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:56.801977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.878248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:56.919224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a269396-0680-4a75-a94f-d1372035f978 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.939106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.958542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:56.959211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:56.959562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:56.959909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:56.960598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:56.961971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb7af-f509-4297-b13b-2c3c377b5fad None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:56.986578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069612-4729-41ba-8cb1-7cfe184626f1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:56.989425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 506/997] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:04:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:04:57.009712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f99dc-075a-4926-8f03-ea43f6a7ce8c None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.010052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f99dc-075a-4926-8f03-ea43f6a7ce8c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.010777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f99dc-075a-4926-8f03-ea43f6a7ce8c None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.012400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 507/998] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:57.017935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.018275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.018531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.036427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849548b-a842-4754-996c-978207378d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.037076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849548b-a842-4754-996c-978207378d2b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.037982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849548b-a842-4754-996c-978207378d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.038381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849548b-a842-4754-996c-978207378d2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.038857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:57.039157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849548b-a842-4754-996c-978207378d2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.040114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:57.040552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849548b-a842-4754-996c-978207378d2b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-b849548b-a842-4754-996c-978207378d2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:57.050952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:57.052075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:04:57.053067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 492/999] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:04:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:57.058727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849548b-a842-4754-996c-978207378d2b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.121152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.133414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 508/1000] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:57.177147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849548b-a842-4754-996c-978207378d2b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.213510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.214121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.214402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.214679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.215347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.215662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.217043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.221927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 493/1001] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:57.227961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.330157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01763848-3a15-4070-b946-c3c88969c1ee None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.340317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.369142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.369752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.370034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.370311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.370943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.371282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.372665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.383009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 509/1002] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:57.384806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.406177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.495202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42df9-d855-460c-8608-405c94910fbc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.512776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.527490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88584661-1759-418f-b28c-503b2693e7a4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.532582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.533189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.533468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.533737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.534431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] RBAC: Adding query filter params (interface=public, service_id=62fc680ea3c64220af4c6499de46a9f7, region_id=RegionOne) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.534735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.536137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.542268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 494/1003] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/endpoints?service_id=62fc680ea3c64220af4c6499de46a9f7&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:57.547592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.576352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.576974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.577246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.577595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] PATH_INFO: `/v3/services/image` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.578085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.579506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:04:57.589018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:04:57.590044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:04:57.590925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 510/1004] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:04:57.595863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.634326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.658341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de40f6-565f-4adc-b899-3bd338a1dd44 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.692970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.694089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.694475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.694749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.695379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.696737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.703411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 495/1005] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:04:57.708906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ae17-fad6-4084-84b7-af8143fd469d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.750260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.750891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.751206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.751537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.752189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] RBAC: Adding query filter params (name=image) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.752499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.753941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087cd19-8cb0-4feb-a770-99179c09b28b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.765050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 511/1006] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:04:57.766573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:57.818263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:57.884059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e44ea-9f82-439b-a0ac-7386767d51ca None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:57.919494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:57.920058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:57.920345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:57.920678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:57.921301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:04:57.921602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:57.922951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcec8-3ce7-4dd4-988b-14be41ffdd03 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:57.927638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 496/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:58.943404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504711df-7bbb-4cfe-a84e-61db876e8397 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:58.943947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504711df-7bbb-4cfe-a84e-61db876e8397 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:58.944026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504711df-7bbb-4cfe-a84e-61db876e8397 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:58.945464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 512/1008] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:58.950406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:58.950791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:58.950963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:58.969261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:58.970454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:59.045310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 497/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:04:59.332837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504711df-7bbb-4cfe-a84e-61db876e8397 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:59.436559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:59.441604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504711df-7bbb-4cfe-a84e-61db876e8397 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:59.475676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:59.476302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.476580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.476850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.477956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:59.479426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e488a-4ae2-40ae-974e-556d794cc978 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:59.481142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 513/1010] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:04:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:04:59.486642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:04:59.527757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:59.588302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac9def-f5e2-4bcb-b7cc-915f9ec21f61 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:04:59.622158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:04:59.622757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.623058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.623332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.623982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:04:59.625398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409384c-bd4f-4d01-9a5f-a37589db531c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:04:59.648550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290ab8-3675-4a6d-b1b5-97b0d22ba5d1 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.648874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290ab8-3675-4a6d-b1b5-97b0d22ba5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.649178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290ab8-3675-4a6d-b1b5-97b0d22ba5d1 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.650623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 514/1011] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:04:59.651707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 498/1012] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:04:59 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:04:59.655900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21be98-846d-43fe-96e1-0ee32015bd47 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.656198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21be98-846d-43fe-96e1-0ee32015bd47 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.656535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21be98-846d-43fe-96e1-0ee32015bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.679316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7e21be98-846d-43fe-96e1-0ee32015bd47 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:59.680568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7e21be98-846d-43fe-96e1-0ee32015bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:59.763704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 515/1013] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:04:59.840919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f1b-cc9e-41a3-92d3-36d04baf65aa None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.841204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f1b-cc9e-41a3-92d3-36d04baf65aa None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.841476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f1b-cc9e-41a3-92d3-36d04baf65aa None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.842943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 499/1014] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:04:59.848067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:04:59.848353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:04:59.848627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:04:59.869023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:04:59.870219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:04:59.938969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 516/1015] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:04:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:00.035123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326f1b-cc9e-41a3-92d3-36d04baf65aa None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:00.132559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:00.145633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326f1b-cc9e-41a3-92d3-36d04baf65aa None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:00.181095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:00.181728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:00.182012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:00.182285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:00.182899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:00.184294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:00.193092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:00.194676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 16:05:00.195892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:00.199318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 500/1016] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:05:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:00.200770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:00.212182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:00.237802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:00.315822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d9f6a-f0c7-464f-9d0c-e2acf4c2316b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:00.316023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf161-a1e7-4bff-8ac0-026f797013a7 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:00.351348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:00.351555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:00.351962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:00.352173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:00.352286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:00.352440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:00.352535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:00.352692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:00.353121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:00.353308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:00.353412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:00.354771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:00.354879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:00.360165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 517/1017] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:05:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:00.367052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:00.372739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 501/1018] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:05:00 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:05:00.468578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:00.479423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa389d6-ebbd-4ef1-b7f6-6a16c0220397 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:00.524403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:00.525013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:00.525296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:00.525567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:00.526194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:00.526491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:00.527901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8aea6-682e-4961-9ec5-4525c1687599 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:00.532911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 518/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Aug 30 16:05:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:00.540208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:00.557163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:00.642558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34efba-ae1e-4894-81a5-5e9632f8c488 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:00.675933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:00.676547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:00.676826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:00.677099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:00.677770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:00.679362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f680a5-ac2a-4c21-bb9e-a20cba700ed9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:00.704498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 502/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:05:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:05:01.672134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbc576-dfca-42b4-9a5b-23716d743d8a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:01.672702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbc576-dfca-42b4-9a5b-23716d743d8a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:01.672702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbc576-dfca-42b4-9a5b-23716d743d8a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:01.674022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 519/1021] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:01.680055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:01.680444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:01.680623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:01.698843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:01.700039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:01.763360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:01.779596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 503/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:02.045698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbc576-dfca-42b4-9a5b-23716d743d8a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:02.149323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbc576-dfca-42b4-9a5b-23716d743d8a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:02.183589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:02.184217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.184493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.184762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.185858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:02.187390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9398c-5162-4c21-9055-0af4a32765da None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:02.189157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 520/1023] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:02.195502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:02.297121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedb0e-765e-4e41-ba3e-2cea4f3b7470 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:02.331250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d94c86-813a-45c5-99da-a5e7fc7056d7 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.331587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d94c86-813a-45c5-99da-a5e7fc7056d7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.331847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d94c86-813a-45c5-99da-a5e7fc7056d7 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.335016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 521/1024] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:02.335178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:02.335178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.335178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.335178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.335763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:02.337207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:02.338489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3006-3cda-4086-a1b3-ca222679e512 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.338844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3006-3cda-4086-a1b3-ca222679e512 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.339234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3006-3cda-4086-a1b3-ca222679e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.363224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-142b3006-3cda-4086-a1b3-ca222679e512 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:02.363885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 504/1025] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:05:02 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:02.368099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-142b3006-3cda-4086-a1b3-ca222679e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:02.385695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:02.447690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 522/1026] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:02.716897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:02.734415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc85fe-2d59-41c0-b762-13038bd2e602 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.734942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc85fe-2d59-41c0-b762-13038bd2e602 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.734942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc85fe-2d59-41c0-b762-13038bd2e602 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.736338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 523/1027] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:02.743272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.743804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.744002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.762463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:02.763702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:02.774050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:02.824382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2917b5-ccc0-4d28-a492-dc6b253f7cf0 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:02.845635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 524/1028] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:02.873291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:02.873917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:02.874196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:02.876252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] PATH_INFO: `/v3/services/image` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:02.876252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:02.876725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:02.886363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:02.891235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:02.892199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 505/1029] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Aug 30 16:05:02 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:02.894169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:02.977660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:02.997786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497175-f5fe-4562-8514-42324d01f102 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.031990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.032594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.032877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.033157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.033784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:03.034088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.035527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.044945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 525/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:03.046404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.117013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.148979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc32e53-862f-48cd-8a2a-f3b4dbb55d46 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.165054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.184821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.185428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.185711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.185987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.186617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] RBAC: Adding query filter params (type=image) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:03.186921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.188322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.193377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 506/1031] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:03.199520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.224243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42998a-0812-47f0-8dd1-ad30d19061b9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.259424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.259994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.260279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.260554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.271056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:03.276534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:03.277627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:03.278667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:03.282658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 526/1032] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:03.283525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.288448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.306464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2818bb5-ebde-419b-b974-b25bdf20743d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.340896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.341507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.341792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.342067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.342784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] RBAC: Adding query filter params (interface=public, service_id=9fa0599471974108bc3643650604528b, region_id=RegionOne) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:03.343105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.344467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.349710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 507/1033] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/endpoints?service_id=9fa0599471974108bc3643650604528b&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:03.355210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.389642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4345-31be-417f-87e4-525e16e94526 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.409644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.425803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.426416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.426702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.426997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.427673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:03.428618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.429945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.438793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 527/1034] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:03.444231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.473070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69b5b-4825-4e0d-8f88-9ebfed6d9a06 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.511337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.511902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.512192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.512467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.513087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.514477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.515147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.531008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 508/1035] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:05:03.560521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae416be-bfd4-4b8d-94fa-8b8c51aeef92 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.598367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.599189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.599483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.599787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.611761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.613305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:03.629049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:03.630092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:03.637347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:03.637347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:03.637347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:03.637347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 528/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:03.637591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.742444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eedc00-1236-4230-bf7b-805ac2865d36 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.751558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.778998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.779548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.779828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.780101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.780747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:03.781052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.782415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.795044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 509/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:03.800587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:03.909129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e245c8e-a783-43e4-8991-7ae9d8fbbb1e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:03.927025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.945571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:03.946203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:03.946484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:03.946758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:03.954497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:03.955971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:05:03.968206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:03.969181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:03.970133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:03.974087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 529/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:03.975207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.080673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c8cd-fde6-45e6-87d4-ef5797bcbd79 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.114477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.116345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.116824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.117294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.118255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:04.118754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:04.120420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3750a-c924-436d-9437-d5d9064407ce None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:04.139107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 510/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:05:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:04.144938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.250253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e52-067a-4259-bbe3-e81f5725b79c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.285289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.285889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.286167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.286479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.336466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.351942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179161-c0bf-41ee-ab83-64c779233453 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.352234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179161-c0bf-41ee-ab83-64c779233453 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.352604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179161-c0bf-41ee-ab83-64c779233453 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.353968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 511/1040] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:04.358548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.358835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.359176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.360123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:04.361585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:04.376967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:04.378169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:04.400754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.454237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 512/1041] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:04.471225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 530/1042] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:04.476929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.580973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5beefd-cafb-48cb-8cf4-b6d60907f894 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.617086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.617637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.617912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.618180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.628190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:04.629628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:04.646294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:04.647881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:04.648773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:04.648773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:04.648773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:04.649034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 513/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:04.654237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.733413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.734035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.747087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.757532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48651-5cd8-4d08-8bc0-345159c2d322 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.794559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.795216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.795512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.795806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.796436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:04.796733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:04.798091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:04.810908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 531/1044] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:04.816131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.842422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2720e0-3308-4341-ad4d-a7e0a769a835 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.887678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.888225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.888506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.888805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.902529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:04.907302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:04.908232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:04.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 514/1045] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:04.914755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:04.926511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544d09-0c80-438b-b2c3-96e8eecdc9d5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:04.965057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:04.965714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:04.965971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:04.966244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:04.973490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:04.975645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:04.977813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.982284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:05:04.991783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:04.992869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:04.993975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:04.996270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 532/1046] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:05.002446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.020339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35caca1-e175-4827-a265-b5d14786a9e5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.054723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.055361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.055643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.055917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.056584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:05.056890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.058264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.071684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 515/1047] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:05.072719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.111332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66da2d-ab74-47fe-9ba3-39f867a8ba9b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.148541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.149237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.149530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.150568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.151298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:05.151611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.153060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.169011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 533/1048] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:05.174787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.184655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda059b-6469-4203-9110-54f2e0d360a5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.217966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:05.225600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.226230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.226687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.226906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] PATH_INFO: `/v3/users/9535f5815a2e453a818caba7461f10aa` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.236064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:05.242879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] RBAC: Authorizing `identity:get_user(user_id=9535f5815a2e453a818caba7461f10aa)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.244365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.246403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 516/1049] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/users/9535f5815a2e453a818caba7461f10aa => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:05.252507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.279937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927811a-3092-4f77-9b4c-3fa31ee56439 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.315843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.316445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.316725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.317008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.317725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] RBAC: Adding query filter params (role.id=671f67c430b64ebeab42232a598fb03c, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:05.318037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.320111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b2ade-7c37-4b30-a78a-f399e54113e0 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.325713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 534/1050] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=671f67c430b64ebeab42232a598fb03c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:05.361650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c60f-1db9-4c8c-ad8e-515ce71ce6bc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.401020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.401565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.401844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.402120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.465203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:05.478726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.480277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.495297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03756e-b1c6-4c9b-8eb4-19f4fc142712 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.495477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03756e-b1c6-4c9b-8eb4-19f4fc142712 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.495687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03756e-b1c6-4c9b-8eb4-19f4fc142712 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.497154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 535/1051] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:05.501852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.502137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.502411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.520408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:05.522158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:05.593167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 517/1052] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 16:05:05.598864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.603972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 536/1053] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:05.687773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:05.701427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998ecc-2a36-48bf-8d64-bdd3d396ca1d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.735241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.736146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.736572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.736990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.738234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.740157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.742669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 518/1054] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:05.748680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.804329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:05.873184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877a99a-7e66-4b4c-b8ea-cf0f018617e1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:05.875238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:05.909408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:05.910195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:05.910474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:05.910746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:05.911497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=62644d0e973d41c6a13355fae2d71452, user.id=9535f5815a2e453a818caba7461f10aa) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:05.911802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:05.913703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:05.923023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 537/1055] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/role_assignments?user.id=9535f5815a2e453a818caba7461f10aa&scope.project.id=62644d0e973d41c6a13355fae2d71452&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:05.994322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ce09-85a3-4469-ba26-f5bd6e270ba5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:06.031693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:06.032450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:06.032762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:06.033040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] PATH_INFO: `/v3/services/image` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:06.033630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:06.035088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:06.044772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:06.045851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:06.046718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 519/1056] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Aug 30 16:05:05 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:06.052146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:06.156453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be311c6-4250-4f88-8338-a3a9cd51082e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:06.172775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:06.192039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:06.192965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:06.193504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:06.194100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:06.194923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] RBAC: Adding query filter params (name=image) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:06.195408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:06.196954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:06.206427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 538/1057] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:06.208144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:06.233693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:06.316278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631986-cef6-4298-b9bd-035a7163d5fd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:06.351198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:06.351806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:06.352079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:06.352348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:06.352972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] RBAC: Adding query filter params (type=image) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:06.353269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:06.354631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f2387-fe2f-490d-987a-8876c8e59312 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:06.359584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 520/1058] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:06.366127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:06.468675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71d85-50cc-427c-ad3c-371106eb2551 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:06.502289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:06.502894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:06.503206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:06.503486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:06.504159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:06.505532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007324f-7dae-4375-9353-72bbb653d9ae None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:06.527851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 539/1059] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:05:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:07.228391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f93c-5053-40ff-8b13-5d51f0b664ff None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.228908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f93c-5053-40ff-8b13-5d51f0b664ff None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.229014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f93c-5053-40ff-8b13-5d51f0b664ff None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.230303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 521/1060] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:07.235507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.235908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.236086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.254815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:07.256101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:07.284738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:07.330372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 540/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:07.605537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1f93c-5053-40ff-8b13-5d51f0b664ff None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:07.694941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:07.713090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1f93c-5053-40ff-8b13-5d51f0b664ff None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:07.747761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:07.748715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.749199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.749691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.760709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-82c764fc-34ae-4170-83fa-60d0a6bb5061 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:07.765670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:07.766597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:07.767487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:07.770060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 522/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:05:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:07.776318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:07.818394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d868b-e8ca-4d8a-83ee-bb938e31dafc None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.818820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d868b-e8ca-4d8a-83ee-bb938e31dafc None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.819054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d868b-e8ca-4d8a-83ee-bb938e31dafc None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.820516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 523/1063] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:07.825100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.825376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.825652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.844128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:07.845464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:07.897791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51320aa-7c1d-4075-9e77-43cbc4264261 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:07.922263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 524/1064] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:07.933702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:07.934308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:07.934587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:07.934858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:07.935552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:07.935854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:07.937217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:07.950722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 541/1065] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:05:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:07.952474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.029704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.057857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b464ee-ccfb-40b8-83f0-b55f56865508 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.092313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.092941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.093221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.093499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.104471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.105915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:08.121944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:08.122917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:08.124130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:08.124130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:08.124130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:08.127293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 525/1066] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:08.128846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.156217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.194655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.236883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9c05-5bee-4113-95ce-06cbcca4b2b7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.271144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.271746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.272021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.272287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.272922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:08.273222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.274583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.286148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 542/1067] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:08.292863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.309852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a1a31-6eeb-40b5-9105-2258bbcba7f1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.335834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.345061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.345694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.345977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.346249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.358713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:08.363551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:08.364654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:08.365928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 526/1068] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:08.370825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.387208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.406867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852c79-cead-48cf-be5b-55c765e22335 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.444552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.445466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.445746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.446018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.453267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.454702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:05:08.466424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:08.467458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:08.469153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 543/1069] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:08.473110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.478805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a820c-f196-4ae0-b521-a5f6d885b702 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.512677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.513385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.513672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.513949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.514615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:08.514921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.516328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55f0d-5ab1-4ee2-b8c5-d7d92ba76342 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.525447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 527/1070] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:08.526798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7926-6ec7-40e5-9e4c-2143107b335e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.527125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7926-6ec7-40e5-9e4c-2143107b335e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.527403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7926-6ec7-40e5-9e4c-2143107b335e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.528597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 528/1071] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:08.532253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d7926-6ec7-40e5-9e4c-2143107b335e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.576593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e825a-9a5f-4be3-8cbf-d0b64609c3b8 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.581342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.610528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.611174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.611454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.611732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.612454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:08.612764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.614197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49cbd6-3bf4-4902-afc2-c9e9f58a1a0d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.631848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 544/1072] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:08.633033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.633323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.633602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.634563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d7926-6ec7-40e5-9e4c-2143107b335e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.640447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.653704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:08.654941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:08.669687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.670250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.670529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.670800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] PATH_INFO: `/v3/users/9535f5815a2e453a818caba7461f10aa` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.671965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] RBAC: Authorizing `identity:get_user(user_id=9535f5815a2e453a818caba7461f10aa)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.673390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.675270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 529/1073] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/users/9535f5815a2e453a818caba7461f10aa => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:08.676033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.723561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 545/1074] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:08.724421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.777291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e0716-9ac1-4977-b6ea-467ac9c67c3e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.795010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.814393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.815043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.815480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.815753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.827177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.828960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:08.846500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:08.847681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:08.848596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:08.848596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:08.848596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:08.848596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 530/1075] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:08.853742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.862918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ab83-5e43-4b9f-b51f-e1253be21f8a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:08.894566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.900448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:08.901785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:08.902064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:08.902351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:08.903518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:08.904991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:08.906663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 546/1076] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:08.913017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:08.968804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad709-8f34-43f5-9f92-095661712ead None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.004485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.005086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.005368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.005636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.007089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:09.007448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.008809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.018327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be89b9-c74e-4e01-bad6-385f8209d5f4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.023721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 531/1077] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:09.024535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.051568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:09.057318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.057981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.058267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.058542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452/users/9535f5815a2e453a818caba7461f10aa/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.060493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] RBAC: Authorizing `identity:create_grant(project_id=62644d0e973d41c6a13355fae2d71452, user_id=9535f5815a2e453a818caba7461f10aa, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.061929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.075293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 547/1078] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:05:08 2022] PUT /identity/v3/projects/62644d0e973d41c6a13355fae2d71452/users/9535f5815a2e453a818caba7461f10aa/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:09.076410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.139646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3196d-7cb3-44d0-b246-ec38141f5eb5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.160744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:09.180477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.181103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.181386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.181663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.213932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9be7ed-3d65-417d-8f78-6c6acbede20c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.258481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.259110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.259337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.260022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.262128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.263913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.267100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.268135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:05:09.280328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:09.281286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:09.282240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 548/1079] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:09.288066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.293597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:09.372425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 532/1080] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:09.377941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.391274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57456-a02f-4532-a7e0-11118a4bad5e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.413853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:09.429957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.430568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.430854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.431169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.431855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:09.432238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.433667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.446662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 549/1081] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:09.452505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.481820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b408-5b9e-40ed-ab7a-6e0bf71ff6e5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.509954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:09.518672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.519354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.519639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.519912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.530777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.532261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:09.547600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:09.548583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:09.550072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:09.550072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:09.550072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:09.550072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 533/1082] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:09.554626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:09.560750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355436e-adff-4929-85c0-01675cc2be6d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.598949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.600021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.600698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.601275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/671f67c430b64ebeab42232a598fb03c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.603809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=aa2fa4b0a3974d0e9b04726511427631, role_id=671f67c430b64ebeab42232a598fb03c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.605596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03167e-ea23-4180-8b13-1cb93041bc23 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.620164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 550/1083] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:05:09 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/aa2fa4b0a3974d0e9b04726511427631/roles/671f67c430b64ebeab42232a598fb03c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:05:09.662088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68da14-6c33-4adc-9692-8434238059c5 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:09.700926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:09.701567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:09.701845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:09.702123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:09.702773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:09.703206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:09.704602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15e5a-dce7-48d1-a24c-4d62d1340e23 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:09.727013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 534/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:10.978895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc450d5-5aaf-4946-ab44-c3b72f8e71c2 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:10.979461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc450d5-5aaf-4946-ab44-c3b72f8e71c2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:10.979461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc450d5-5aaf-4946-ab44-c3b72f8e71c2 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:10.980814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 551/1085] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:10.986121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:10.986605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:10.986707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.005124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:11.006912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:11.040791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:11.075950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 535/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:11.346442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc450d5-5aaf-4946-ab44-c3b72f8e71c2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.389965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:11.449410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc450d5-5aaf-4946-ab44-c3b72f8e71c2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:11.483488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe642126-446b-436a-8141-285508578590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:11.484117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642126-446b-436a-8141-285508578590 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.484398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642126-446b-436a-8141-285508578590 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.484671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642126-446b-436a-8141-285508578590 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.495778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe642126-446b-436a-8141-285508578590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-fe642126-446b-436a-8141-285508578590 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:11.500791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:11.501758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:11.502603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 552/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:11.507954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.532226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e2f-b65e-40ce-8be3-be6415d8676d None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.532575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e2f-b65e-40ce-8be3-be6415d8676d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.532807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e2f-b65e-40ce-8be3-be6415d8676d None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.534133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 553/1088] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:11.539743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.540027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.540307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.558019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:11.559250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:11.608942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e3dea-4437-40c1-a431-49f6e149bc72 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:11.626419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 554/1089] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 16:05:11.642069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:11.642669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.642950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.643260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.643923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:11.644223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:11.645590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:11.654016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 536/1090] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:11.659682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.688907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:11.757892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3283bf-f9dd-4372-a190-7e10aa1d75ed None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:11.793763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:11.794410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.794685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.794954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] PATH_INFO: `/v3/users/9535f5815a2e453a818caba7461f10aa` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:11.796175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] RBAC: Authorizing `identity:get_user(user_id=9535f5815a2e453a818caba7461f10aa)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:11.797608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:11.799200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 555/1091] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/users/9535f5815a2e453a818caba7461f10aa => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:11.805859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.836941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:11.898144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:11.910095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9969-5049-494a-92f1-b187ff9acae6 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:11.944886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:11.945493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:11.945779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:11.946049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.000765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.005481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1999d-3f94-4c18-8a21-a1f4b8c88812 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.013202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.014650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.040079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.040702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.040987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.041259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.044925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.051230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:12.056736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:12.057874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:12.059153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 556/1092] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:12.063681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.123128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 537/1093] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:12.124424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.160907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6ee9-42df-4f3d-b3f6-1c6429f3fa4d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.196069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.196664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.196936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.197586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.198254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:12.198558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.200290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.208296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 557/1094] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:12.214148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.223360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd626d-c4d8-4148-9087-a591eaa93882 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.235123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.253588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.259485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.260115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.260393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.260666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.261902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.263373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.265153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 538/1095] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:12.270948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.316947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6398a5-b211-4762-833f-065fc0bd0764 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.351694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab088e-8236-4980-b354-f5433334233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.352685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab088e-8236-4980-b354-f5433334233a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.353116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab088e-8236-4980-b354-f5433334233a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.353395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab088e-8236-4980-b354-f5433334233a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.364395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab088e-8236-4980-b354-f5433334233a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.366169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab088e-8236-4980-b354-f5433334233a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.370666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f96a-98a6-46d1-833d-1dc1afe0ee51 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2aab088e-8236-4980-b354-f5433334233a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:12.380037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:12.381142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:12.382233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:12.382233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:12.382233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:12.382233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 558/1096] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:12.387064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab088e-8236-4980-b354-f5433334233a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.405934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.406536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.406811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.407108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.407836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=62644d0e973d41c6a13355fae2d71452, user.id=9535f5815a2e453a818caba7461f10aa) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:12.408145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.409561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.416282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 539/1097] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/role_assignments?user.id=9535f5815a2e453a818caba7461f10aa&scope.project.id=62644d0e973d41c6a13355fae2d71452&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:12.461722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.496638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab088e-8236-4980-b354-f5433334233a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.533034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.533658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.533940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.534214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.534863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:12.535195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.536601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.550378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 559/1098] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:12.555969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.620682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.659056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1678e-5224-4e86-b8d2-b3fab06c9fed None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.691718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.692264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.692543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.692816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.700729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.702150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:05:12.713733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:12.714869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:12.716066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 540/1099] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:12.720851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.819781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e5129-40b2-4384-b0fb-0c2094b4efdf None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:12.848221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.855479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:12.856089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:12.856367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:12.856636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:12.857359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:12.857661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:12.859120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:12.877236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 560/1100] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:12.883020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:12.983647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659a229-4942-442c-8f9e-4701bf8166b4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.007101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.017944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.018543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.018818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.019117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.087225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.088655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.187984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 541/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:13.194577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:13.292273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b7dc-1925-45bc-90d0-3c57a8816cd9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.325290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.325908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.326187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.326463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.336213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.337660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:13.352210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:13.358041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:05:13.359228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:13.359228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:05:13.359228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:13.359228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 561/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:13.359514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:13.384112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.459880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedd895-4921-469f-8e92-66077d07b746 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.493719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.494318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.494598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.494873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.495542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:13.495845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.497204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.508395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 542/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:13.514916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:13.559830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.614304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb3f9-790f-4399-a3b5-aacc5352c8d1 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.647710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.648325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.648606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.648875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.655323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.656764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:05:13.668637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:13.669684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:13.670612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 562/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:13.675602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:13.761242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.776980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd4756-6774-4c04-a1a0-e20ce5ddcaf9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.810385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.810919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.811224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.811500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.812186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:13.812493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.813925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbbfe-1fe8-4a2b-b714-1cc1ea9d3996 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.826757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 543/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:13.832831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:13.931541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9d94-d77f-4b49-bb3d-d3bb7d1be413 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:13.933080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.966128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:13.966726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:13.967027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:13.967301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:13.968016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] RBAC: Adding query filter params (role.id=671f67c430b64ebeab42232a598fb03c, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=aa2fa4b0a3974d0e9b04726511427631) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:13.968323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:13.969752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7eda-71d5-42e1-a8af-6cc516a2ffb9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:13.975489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 563/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:13 2022] GET /identity/v3/role_assignments?user.id=aa2fa4b0a3974d0e9b04726511427631&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=671f67c430b64ebeab42232a598fb03c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:14.380411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bba4-2afe-43d6-bbfe-f92f6a2b40a8 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:14.381458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bba4-2afe-43d6-bbfe-f92f6a2b40a8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:14.381563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bba4-2afe-43d6-bbfe-f92f6a2b40a8 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:14.382927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 544/1107] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:14.388292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:14.388696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:14.388864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:14.407066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:14.408237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:14.476230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 564/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:14.749944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5bba4-2afe-43d6-bbfe-f92f6a2b40a8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:14.851905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5bba4-2afe-43d6-bbfe-f92f6a2b40a8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:14.885561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:14.886173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:14.886711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:14.887008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:14.888112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:14.889533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2a3de-c89d-4d49-9013-c21ba11bb38f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:14.891256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 545/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:14.897372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:14.986167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:14.992667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e42c-fd59-46b3-a329-0b6d83a97a6e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:15.025730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:15.026261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:15.026537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:15.026808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:15.027479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:15.028892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac9751-93f5-4b78-b9b3-6522db3afb5f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:15.048837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 565/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:05:14 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:16.962973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565cb0-4c61-42c0-a994-ce4c1e2b0bd7 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:16.963556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565cb0-4c61-42c0-a994-ce4c1e2b0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:16.963556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565cb0-4c61-42c0-a994-ce4c1e2b0bd7 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:16.964882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 546/1111] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:16.969984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:16.970405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:16.970536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:16.988719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:16.989905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:17.055925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 566/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:17.331665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1565cb0-4c61-42c0-a994-ce4c1e2b0bd7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:17.346351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:17.431700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1565cb0-4c61-42c0-a994-ce4c1e2b0bd7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:17.464022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:17.464635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:17.464917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:17.465184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] PATH_INFO: `/v3/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:17.466549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] RBAC: Authorizing `identity:get_role(role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:17.467921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:17.469203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 547/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:17 2022] GET /identity/v3/roles/d34b130893c44c4697b28b2f332822a6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:17.475040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:17.554272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:17.573067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe18742-71b8-4fea-a2d7-e8d593d7e1a1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:17.605208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:17.605769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:17.606048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:17.606324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] PATH_INFO: `/v3/users/1dfebd86226e48b48bf1cc7c8354e994` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:17.619450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] RBAC: Authorizing `identity:get_user(user_id=1dfebd86226e48b48bf1cc7c8354e994)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:17.620892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:17.622463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 567/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:17 2022] GET /identity/v3/users/1dfebd86226e48b48bf1cc7c8354e994 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:17.628199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:17.707446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:17.728060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c947fb-b039-4dcc-b125-0452079b511b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:17.763914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:17.764884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:17.765396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:17.765880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:17.834619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:17.836108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:17.917075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:17.938469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 548/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:17.945466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:18.044326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226826f-baed-4760-9389-e981b03cfab4 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:18.076982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:18.077595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:18.077874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:18.078146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:18.079277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:18.080705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb18cc5-501f-47d0-8193-a9850ef0ad08 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:18.082321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 568/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:17 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:18.088560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:18.184481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c2374-c4e7-4b2f-90bf-16ce610f415b None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:18.216913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:18.217497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:18.217775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:18.218042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:18.218749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=62644d0e973d41c6a13355fae2d71452, user.id=1dfebd86226e48b48bf1cc7c8354e994) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:18.219080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:18.220491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611aa29-2d96-4fc9-8b42-3f532b1e2a6a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:18.226235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 549/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:18 2022] GET /identity/v3/role_assignments?user.id=1dfebd86226e48b48bf1cc7c8354e994&scope.project.id=62644d0e973d41c6a13355fae2d71452&role.id=d34b130893c44c4697b28b2f332822a6 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:20.105655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c476-37b3-4a6f-9c9b-7fabc2f22d7a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.106179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c476-37b3-4a6f-9c9b-7fabc2f22d7a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.106179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c476-37b3-4a6f-9c9b-7fabc2f22d7a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.107473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 569/1118] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:20.112693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.113073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.113273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.132604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:20.133802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:20.172479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:20.199307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 550/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:20.470182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578c476-37b3-4a6f-9c9b-7fabc2f22d7a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.481032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:20.570840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578c476-37b3-4a6f-9c9b-7fabc2f22d7a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.603876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.604486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.604767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.605041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] PATH_INFO: `/v3/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.606423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] RBAC: Authorizing `identity:get_role(role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.607825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.609125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 570/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/roles/d34b130893c44c4697b28b2f332822a6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:20.614864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.714917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde185-e375-4ea2-a96f-e3205801fe67 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.749306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.749874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.750154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.750428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] PATH_INFO: `/v3/users/1dfebd86226e48b48bf1cc7c8354e994` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.751567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] RBAC: Authorizing `identity:get_user(user_id=1dfebd86226e48b48bf1cc7c8354e994)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.752991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.754552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 551/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/users/1dfebd86226e48b48bf1cc7c8354e994 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:20.760885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.834343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:20.857000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb38d-e4ed-4bc0-a904-18b1311ccd6a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:20.889645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:20.890262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:20.890538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:20.890810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:20.891935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:20.893356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6044-b7ed-4e25-b1b0-8e0c44f6b932 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:20.894955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 571/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:20 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:20.900992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:20.943851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:20.999781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a51d-8e9b-49fe-94f6-c634f0e23c30 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:21.032460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:21.033105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:21.033387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:21.033663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452/users/1dfebd86226e48b48bf1cc7c8354e994/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:21.035816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] RBAC: Authorizing `identity:create_grant(project_id=62644d0e973d41c6a13355fae2d71452, user_id=1dfebd86226e48b48bf1cc7c8354e994, role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:21.037858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b94683-6d06-4e57-874f-2b2d0812afcd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:21.050304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 552/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:05:20 2022] PUT /identity/v3/projects/62644d0e973d41c6a13355fae2d71452/users/1dfebd86226e48b48bf1cc7c8354e994/roles/d34b130893c44c4697b28b2f332822a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:22.918550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f55a-4c46-44d2-9b4c-11e53ebb716d None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:22.919096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f55a-4c46-44d2-9b4c-11e53ebb716d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:22.919096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f55a-4c46-44d2-9b4c-11e53ebb716d None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:22.920443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 572/1124] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:22.925682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:22.926099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:22.926234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:22.945328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:22.946525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:23.012642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 553/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:23.282921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56f55a-4c46-44d2-9b4c-11e53ebb716d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:23.381257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56f55a-4c46-44d2-9b4c-11e53ebb716d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:23.414613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:23.415241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:23.415522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:23.415797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] PATH_INFO: `/v3/roles/d34b130893c44c4697b28b2f332822a6` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:23.417180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] RBAC: Authorizing `identity:get_role(role_id=d34b130893c44c4697b28b2f332822a6)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:23.418547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:23.419875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 573/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:23 2022] GET /identity/v3/roles/d34b130893c44c4697b28b2f332822a6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:23.425603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:23.455114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:23.522788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa742d6-5f23-4ad3-9f1b-865d8eb4ed4f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:23.556076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:23.556628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:23.556912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:23.557189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] PATH_INFO: `/v3/users/1dfebd86226e48b48bf1cc7c8354e994` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:23.558304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] RBAC: Authorizing `identity:get_user(user_id=1dfebd86226e48b48bf1cc7c8354e994)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:23.559766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:23.561322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 554/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:23 2022] GET /identity/v3/users/1dfebd86226e48b48bf1cc7c8354e994 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:23.567124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:23.582276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:23.665041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764706-44a4-4994-a895-4d53285e5ba1 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:23.698101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:23.698693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:23.698974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:23.699274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:23.763568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:23.765010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:23.777879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:23.862927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 574/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:23.869475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:23.963387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:23.966251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5196f9-f7e7-4d1b-815d-fe08f685d721 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:24.000457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:24.001066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:24.001346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:24.001617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] PATH_INFO: `/v3/projects/62644d0e973d41c6a13355fae2d71452` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:24.002721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] RBAC: Authorizing `identity:get_project(project_id=62644d0e973d41c6a13355fae2d71452)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:24.004176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d86781-8926-44ec-b560-7d1dae1b3c18 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:24.005805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 555/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:23 2022] GET /identity/v3/projects/62644d0e973d41c6a13355fae2d71452 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:24.011907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:24.108400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5af3-d7df-431d-8d2f-45d5fe53c12b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:24.121441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:24.142024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:24.142610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:24.142887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:24.143187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:24.143894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] RBAC: Adding query filter params (role.id=d34b130893c44c4697b28b2f332822a6, scope.project.id=62644d0e973d41c6a13355fae2d71452, user.id=1dfebd86226e48b48bf1cc7c8354e994) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:24.144208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:24.145626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d2726-ee5b-4710-88e2-0074b8495c5b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:24.151975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 575/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:24 2022] GET /identity/v3/role_assignments?user.id=1dfebd86226e48b48bf1cc7c8354e994&scope.project.id=62644d0e973d41c6a13355fae2d71452&role.id=d34b130893c44c4697b28b2f332822a6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:26.070451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237294-bfa2-462b-b7d2-c7910b7d0c9c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:26.071015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237294-bfa2-462b-b7d2-c7910b7d0c9c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:26.071015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237294-bfa2-462b-b7d2-c7910b7d0c9c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:26.072346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 556/1131] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:26.077536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:26.077925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:26.078082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:26.096634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:26.097734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:26.163131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 576/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:26.432466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85237294-bfa2-462b-b7d2-c7910b7d0c9c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:26.532378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85237294-bfa2-462b-b7d2-c7910b7d0c9c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:26.565332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:26.565946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:26.566225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:26.566494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:26.567601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:26.570003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c6c42-574a-4884-8c3e-7754557f457d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:26.571572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 557/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:26.577213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:26.672492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c446d58-7007-4114-8e37-9d881f9d8085 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:26.680311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:26.706730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:26.707363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:26.707643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:26.707918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:26.708569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:26.710060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dfd0-a62d-4539-8a79-a84eab4d2cc1 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:26.736414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 577/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:05:26 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:28.654242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bfc4-137c-4f3a-bf75-4b4c19d1f606 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:28.654794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bfc4-137c-4f3a-bf75-4b4c19d1f606 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:28.654794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bfc4-137c-4f3a-bf75-4b4c19d1f606 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:28.656148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 558/1135] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:28.661242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:28.661685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:28.661820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:28.680089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:28.681276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:28.746654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 578/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:29.016368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2bfc4-137c-4f3a-bf75-4b4c19d1f606 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:29.052346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:29.118354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2bfc4-137c-4f3a-bf75-4b4c19d1f606 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:29.151091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:29.151706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:29.151987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:29.152262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:29.153357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:29.154772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa8430-6d92-4d7c-a44a-6283e30a5a7e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:29.156345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 559/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:29.162761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:29.248568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:29.261505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6418-042b-47ec-baf8-b7d87ce3d601 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:29.294810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:29.295367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:29.295651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:29.295923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:29.296559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:29.297992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819ea06-7945-43d2-ad93-b2b41ba382ce None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:29.318706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 579/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:05:29 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:31.263479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7b707-a15a-421d-b798-74003f6fd670 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:31.264024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7b707-a15a-421d-b798-74003f6fd670 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:31.264024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7b707-a15a-421d-b798-74003f6fd670 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:31.265335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 560/1139] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:31.270547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898719d6-1a25-4795-9796-e688e214f45b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:31.270927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898719d6-1a25-4795-9796-e688e214f45b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:31.271952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898719d6-1a25-4795-9796-e688e214f45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:31.290281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-898719d6-1a25-4795-9796-e688e214f45b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:31.291517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-898719d6-1a25-4795-9796-e688e214f45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:31.356690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 580/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:31.628143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7b707-a15a-421d-b798-74003f6fd670 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:31.729085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7b707-a15a-421d-b798-74003f6fd670 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:31.731313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:31.763493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:31.764108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:31.764386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:31.764657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:31.774455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:31.779214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:31.780265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:31.781484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 561/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:31.786345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898719d6-1a25-4795-9796-e688e214f45b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:31.860240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:31.887120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898719d6-1a25-4795-9796-e688e214f45b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:31.920652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:31.921251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:31.921532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:31.921806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:31.922464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:31.922770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:31.924173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:31.932222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 581/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:31.938028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:32.034242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169c6-95e5-4e69-878c-12d089fbe2e9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:32.067223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:32.068336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:32.068621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:32.068900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] PATH_INFO: `/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:32.081354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] RBAC: Authorizing `identity:get_user(user_id=2d2a519ebbc448e68bf861e6ffa5ae5d)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:32.082770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:32.084928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 562/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:31 2022] GET /identity/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:32.090839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:32.189737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ab30-2a23-418c-93f3-5aa739a8d6fd None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:32.223949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:32.225515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:32.225792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:32.226061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:32.229336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:32.292616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:32.294059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:32.387579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 582/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:32.393529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:32.418631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:32.492413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467aee5-dfde-4edb-8dc6-1cb7e660af9f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:32.525063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:32.525672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:32.525951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:32.526223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] PATH_INFO: `/v3/projects/47c79886cdb140f588681b72a1a1ed1d` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:32.527344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] RBAC: Authorizing `identity:get_project(project_id=47c79886cdb140f588681b72a1a1ed1d)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:32.528755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a659-0afa-4310-81a6-c41c4bdb852c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:32.530337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 563/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:32 2022] GET /identity/v3/projects/47c79886cdb140f588681b72a1a1ed1d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:32.536396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:32.570040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:32.634733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be475c2-a0eb-4256-a5eb-75aa15aceeec None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:32.668339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:32.668928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:32.669206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:32.669475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:32.670183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=47c79886cdb140f588681b72a1a1ed1d, user.id=2d2a519ebbc448e68bf861e6ffa5ae5d) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:32.670485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:32.671922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577dcce-3674-4f59-a634-b1f9024263e8 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:32.677073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 583/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:32 2022] GET /identity/v3/role_assignments?user.id=2d2a519ebbc448e68bf861e6ffa5ae5d&scope.project.id=47c79886cdb140f588681b72a1a1ed1d&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:34.546272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c906-2def-452d-909e-1e8bc2939e3a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:34.546822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c906-2def-452d-909e-1e8bc2939e3a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:34.546822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85c906-2def-452d-909e-1e8bc2939e3a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:34.548153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 564/1147] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:34.553329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:34.553742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:34.553876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:34.572298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:34.573475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:34.638325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 584/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:34.905488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85c906-2def-452d-909e-1e8bc2939e3a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:34.996329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:35.007182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85c906-2def-452d-909e-1e8bc2939e3a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:35.040627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:35.041233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:35.041510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:35.041780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:35.051512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:35.056532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:35.057616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:35.058643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 565/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:35.063944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:35.094457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:35.164065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afc280-6b15-46a8-9e8f-71fa1db057ec None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:35.197217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:35.197810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:35.198088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:35.198361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:35.199046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:35.199351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:35.200720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:35.209038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 585/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:35.214802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:35.311199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d804a-d882-4eda-b7a7-db5719ea38d3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:35.343213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:35.343816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:35.344093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:35.344363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] PATH_INFO: `/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:35.345500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2a519ebbc448e68bf861e6ffa5ae5d)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:35.346868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:35.348427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 566/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:35 2022] GET /identity/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:35.354666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:35.443258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:35.451960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311cfb-d554-423a-b6a2-a48d471c8b34 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:35.484406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:35.485018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:35.485296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:35.485566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] PATH_INFO: `/v3/projects/47c79886cdb140f588681b72a1a1ed1d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:35.486660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] RBAC: Authorizing `identity:get_project(project_id=47c79886cdb140f588681b72a1a1ed1d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:35.488125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2344b8c-7507-4e0b-bc4c-0be4c5d5efeb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:35.489744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 586/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:35 2022] GET /identity/v3/projects/47c79886cdb140f588681b72a1a1ed1d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:35.496123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:35.514909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:35.593091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da13f-3cb0-44ed-b33b-70d47d805750 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:35.626228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:35.626814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:35.627125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:35.627400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] PATH_INFO: `/v3/projects/47c79886cdb140f588681b72a1a1ed1d/users/2d2a519ebbc448e68bf861e6ffa5ae5d/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:35.629266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] RBAC: Authorizing `identity:create_grant(project_id=47c79886cdb140f588681b72a1a1ed1d, user_id=2d2a519ebbc448e68bf861e6ffa5ae5d, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:35.630719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa1528-aa1f-4887-886c-b85d0dc7a684 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:35.643609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 567/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:05:35 2022] PUT /identity/v3/projects/47c79886cdb140f588681b72a1a1ed1d/users/2d2a519ebbc448e68bf861e6ffa5ae5d/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:37.507441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b9a69-d659-49ae-82e7-a353bcc717a2 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:37.507995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b9a69-d659-49ae-82e7-a353bcc717a2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:37.508108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b9a69-d659-49ae-82e7-a353bcc717a2 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:37.509525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 587/1154] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:05:37.514869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:37.515307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:37.515459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:37.533742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:37.534933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:37.599580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 568/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:37.868741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b9a69-d659-49ae-82e7-a353bcc717a2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:37.967089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b9a69-d659-49ae-82e7-a353bcc717a2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.000174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.000782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.001062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.001329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.010996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:38.015682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:38.016758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:38.017649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 588/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:38.023288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:38.033242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.120136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28803b5e-71bd-400f-aa45-b3d5fff156a5 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.153419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.154021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.154298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.154568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.155269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:38.155572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:38.156926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:38.164836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 569/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:38.170434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:38.192329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.269881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582cf1-6d31-41bd-9b53-8e2d83e5fac2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.302987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.303629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.303912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.304190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] PATH_INFO: `/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.305311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2a519ebbc448e68bf861e6ffa5ae5d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:38.306754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:38.308359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 589/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:38 2022] GET /identity/v3/users/2d2a519ebbc448e68bf861e6ffa5ae5d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:38.314263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:38.381800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.413077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec6d18-be02-49fa-8a41-8f6adb143bbc None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.445986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.446571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.446848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.447148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.510462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:38.511913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:38.576216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.606694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 570/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:38.612554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:38.699205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.711552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf375-9a10-42bb-b0e4-ca6d540180b9 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.744837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.745450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.745729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.746000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] PATH_INFO: `/v3/projects/47c79886cdb140f588681b72a1a1ed1d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.747119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] RBAC: Authorizing `identity:get_project(project_id=47c79886cdb140f588681b72a1a1ed1d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:38.748544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd966b1-1b7e-46e7-bd9b-3764cada284d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:38.750138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 590/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:38 2022] GET /identity/v3/projects/47c79886cdb140f588681b72a1a1ed1d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:38.756742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:38.853011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333221-7064-41d4-a9bc-149205d02749 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:38.886608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:38.887229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:38.887510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:38.887781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:38.888492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=47c79886cdb140f588681b72a1a1ed1d, user.id=2d2a519ebbc448e68bf861e6ffa5ae5d) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:38.888801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:38.890215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dd882-ef2d-404b-b825-f2a820e3c7e6 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:38.895759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 571/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:38 2022] GET /identity/v3/role_assignments?user.id=2d2a519ebbc448e68bf861e6ffa5ae5d&scope.project.id=47c79886cdb140f588681b72a1a1ed1d&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:40.803770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616776f-d52b-427e-aed0-5df59d971317 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:40.804327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616776f-d52b-427e-aed0-5df59d971317 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:40.804327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616776f-d52b-427e-aed0-5df59d971317 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:40.805640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 591/1162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:40.810852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:40.811253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:40.811446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:40.829633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:40.830816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:40.857882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:40.898674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 572/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:41.169934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616776f-d52b-427e-aed0-5df59d971317 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:41.269234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616776f-d52b-427e-aed0-5df59d971317 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:41.301922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:41.303123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:41.303408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:41.303682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:41.326828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:41.369055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:41.370508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:41.464876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 592/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:41.470896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:41.566246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f54a9b-3322-4a4a-9bba-836f91d43fe4 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:41.599051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:41.599572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:41.599852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:41.600125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:41.606573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:41.608028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-55e87fca-79a3-4712-ad98-f81d6499ba53 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:41.620175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:41.621402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:41.622457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 573/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:05:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:41.627174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:41.681845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:41.723493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5510-e839-416d-a05f-cd87ddf2784c None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:41.758783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:41.759403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:41.759685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:41.759955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:41.760582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:41.760885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:41.762243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68832bf-e550-4444-bc32-a0c80d8e6726 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:41.769094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 593/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Aug 30 16:05:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:43.799302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120c09-350b-420e-bed5-f8aa881661f2 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:43.799831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120c09-350b-420e-bed5-f8aa881661f2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:43.799831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120c09-350b-420e-bed5-f8aa881661f2 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:43.801173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 574/1167] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:43.807009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf56b-7f7c-4bb1-93ae-0b4df15430fc None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:43.807414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf56b-7f7c-4bb1-93ae-0b4df15430fc None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:43.807560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf56b-7f7c-4bb1-93ae-0b4df15430fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:43.825968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d4edf56b-7f7c-4bb1-93ae-0b4df15430fc None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:43.827169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d4edf56b-7f7c-4bb1-93ae-0b4df15430fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:43.894110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 594/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:44.165391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21120c09-350b-420e-bed5-f8aa881661f2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:44.190674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:44.273727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21120c09-350b-420e-bed5-f8aa881661f2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:44.306686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:44.307311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:44.307592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:44.307866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:44.308542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:44.309903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2378edd-f03a-4118-91d1-75561d8a8630 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:44.325121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 575/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Aug 30 16:05:44 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:46.220327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6cf5f-5a1c-4698-b751-a84415173f81 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:46.220859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6cf5f-5a1c-4698-b751-a84415173f81 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:46.220859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6cf5f-5a1c-4698-b751-a84415173f81 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:46.222188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 595/1170] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:46.227815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:46.228188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:46.228365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:46.248712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:46.249889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:46.313702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 576/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:46.582931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6cf5f-5a1c-4698-b751-a84415173f81 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:46.633903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:46.683605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6cf5f-5a1c-4698-b751-a84415173f81 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:46.716384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:46.717005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:46.717290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:46.717566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] PATH_INFO: `/v3/domains/08d8a14e856e4467acabaa5333b89e8f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:46.727546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=08d8a14e856e4467acabaa5333b89e8f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:46.728991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a2a7a-640d-4b9a-a382-5df46ce7d342 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:46.730558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 596/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Aug 30 16:05:46 2022] GET /identity/v3/domains/08d8a14e856e4467acabaa5333b89e8f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:46.736390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:46.751597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:46.834595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e079-ab86-4b7c-add5-2b3d75abcbb7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:46.868922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:46.869526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:46.869810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:46.870084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:46.870729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:46.872206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210263-35b9-4577-890f-e36e3aba4f3d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:46.898922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 577/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:05:46 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:48.792709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1a31-7b87-4334-9fe8-aaa83bd4627f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:48.793318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1a31-7b87-4334-9fe8-aaa83bd4627f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:48.793318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1a31-7b87-4334-9fe8-aaa83bd4627f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:48.794575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 597/1174] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:48.799904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:48.800308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:48.800466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:48.819032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:48.820222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:48.878313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:48.887212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 578/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:49.158765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d1a31-7b87-4334-9fe8-aaa83bd4627f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:49.258151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d1a31-7b87-4334-9fe8-aaa83bd4627f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:49.267877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:49.290947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:49.291591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:49.291868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:49.292140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] PATH_INFO: `/v3/domains/08d8a14e856e4467acabaa5333b89e8f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:49.293235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=08d8a14e856e4467acabaa5333b89e8f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:49.294654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c3a7-6aca-413b-bef7-1892d03b3829 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:49.296225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 598/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Aug 30 16:05:49 2022] GET /identity/v3/domains/08d8a14e856e4467acabaa5333b89e8f => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:49.302484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:49.398185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ed122-f410-46d3-828f-9064d27de5a4 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:49.432343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:49.432873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:49.433154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:49.433429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:49.434082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:49.435554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f907f-a97b-435a-90f7-6266bcfb4b3a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:49.456004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 579/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:05:49 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:05:51.381913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56615e-8c25-426c-85a7-a3f53b1a844d None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:51.382464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56615e-8c25-426c-85a7-a3f53b1a844d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:51.382464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56615e-8c25-426c-85a7-a3f53b1a844d None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:51.383831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 599/1178] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:51.389085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:51.389466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:51.389637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:51.408051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:51.409236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:51.454055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:51.474519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 580/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:51.741904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56615e-8c25-426c-85a7-a3f53b1a844d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:51.841484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56615e-8c25-426c-85a7-a3f53b1a844d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:51.874324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:51.874937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:51.875240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:51.875510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:51.885711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:51.890370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:51.891547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:51.892459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 600/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:05:51.898199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:51.995298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f234ba0-87e7-4853-a8b4-124f557ad797 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.029099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.029693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.029975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.030250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.030913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:52.031247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.032614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.040500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 581/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:52.046179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.085550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:52.144696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b3d-2264-4038-a531-ff909b7b28e2 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.176595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.177862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.178156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.178425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] PATH_INFO: `/v3/users/a29630a189bb433da2eff47a5c0321ad` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.190748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] RBAC: Authorizing `identity:get_user(user_id=a29630a189bb433da2eff47a5c0321ad)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.192203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.194406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 601/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:52 2022] GET /identity/v3/users/a29630a189bb433da2eff47a5c0321ad => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:52.200209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.245766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:52.305451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9fcd9-349f-495a-9906-79dc55a9da05 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.337617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.338210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.338486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.338756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.403637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.405061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.447833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:52.501055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 582/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:52.506998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.597053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:52.603685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca9e3-bb77-4628-89c7-5a6b534d84c7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.636915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.637535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.637813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.638085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] PATH_INFO: `/v3/projects/4a388b87e6804d5997b65caaf0707fe2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.639212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] RBAC: Authorizing `identity:get_project(project_id=4a388b87e6804d5997b65caaf0707fe2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.640640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404005f3-b580-41a6-9d64-4426f3b6938a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.642243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 602/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:52 2022] GET /identity/v3/projects/4a388b87e6804d5997b65caaf0707fe2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:52.648824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:52.747622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6910b-65ba-4c46-aa0d-7d52f82e1d50 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:52.780406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:52.780935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:52.781215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:52.781485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:52.782202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=4a388b87e6804d5997b65caaf0707fe2, user.id=a29630a189bb433da2eff47a5c0321ad) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:52.782511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:52.783953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102ee2-0b5e-49bb-936b-ec05d91ae61a None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:52.790056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 583/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:52 2022] GET /identity/v3/role_assignments?user.id=a29630a189bb433da2eff47a5c0321ad&scope.project.id=4a388b87e6804d5997b65caaf0707fe2&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:05:54.666827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e233e9-abf4-4eea-aa84-68b49bc3a817 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:54.667407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e233e9-abf4-4eea-aa84-68b49bc3a817 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:54.667407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e233e9-abf4-4eea-aa84-68b49bc3a817 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:54.668742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 603/1186] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:54.674003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:54.674386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:54.674548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:54.692157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:54.693823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:54.695762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:54.759358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 584/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:55.024421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e233e9-abf4-4eea-aa84-68b49bc3a817 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:55.123471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e233e9-abf4-4eea-aa84-68b49bc3a817 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:55.156682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:55.157298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:55.157576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:55.157846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:55.168362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:55.173042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:55.174107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:05:55.175324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 604/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:55.180303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:55.276248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac04ad-58ce-4565-9eb9-0eb1f6461006 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:55.308591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:55.309184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:55.309461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:55.309729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:55.310384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:55.310686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:55.312069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:55.316826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:55.320904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 585/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:55.326396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:55.352520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:55.424861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfaa2e-57b5-45fa-9032-ef615a01b17d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:55.457579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:55.458816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:55.459133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:55.459409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] PATH_INFO: `/v3/users/a29630a189bb433da2eff47a5c0321ad` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:55.460523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] RBAC: Authorizing `identity:get_user(user_id=a29630a189bb433da2eff47a5c0321ad)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:55.461957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:55.463544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 605/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:55 2022] GET /identity/v3/users/a29630a189bb433da2eff47a5c0321ad => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:55.469312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:55.567139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391466d-90f5-4f66-a79f-0aca6c66df32 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:55.600027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:55.600634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:55.600916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:55.601191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] PATH_INFO: `/v3/projects/4a388b87e6804d5997b65caaf0707fe2` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:55.602305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] RBAC: Authorizing `identity:get_project(project_id=4a388b87e6804d5997b65caaf0707fe2)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:55.603752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69966c4b-b094-45d7-842e-6b21fc91d4fa None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:55.605347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 586/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:55 2022] GET /identity/v3/projects/4a388b87e6804d5997b65caaf0707fe2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:55.611149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:55.699622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:55.708930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd333-6b9b-4999-a5ac-876a23dfad27 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:55.742249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:55.742898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:55.743214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:55.743491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] PATH_INFO: `/v3/projects/4a388b87e6804d5997b65caaf0707fe2/users/a29630a189bb433da2eff47a5c0321ad/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:55.745381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a388b87e6804d5997b65caaf0707fe2, user_id=a29630a189bb433da2eff47a5c0321ad, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:55.746824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf9059-d908-447d-8f66-da94a909cb88 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:55.759232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 606/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:05:55 2022] PUT /identity/v3/projects/4a388b87e6804d5997b65caaf0707fe2/users/a29630a189bb433da2eff47a5c0321ad/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:05:57.631948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94d6a-6763-4c96-a891-023ec66faeb3 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:57.632534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94d6a-6763-4c96-a891-023ec66faeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:57.632534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94d6a-6763-4c96-a891-023ec66faeb3 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:57.633791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 587/1193] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:05:57.639032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:57.639448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:57.639588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:57.657967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:05:57.659181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:05:57.724000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 607/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:05:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:57.992567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94d6a-6763-4c96-a891-023ec66faeb3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.057825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.091881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94d6a-6763-4c96-a891-023ec66faeb3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:58.124376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:58.124985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:58.125270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:58.125544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:58.135860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:05:58.140569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:05:58.141661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:05:58.142678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 588/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:05:58.148109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.227755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.246950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42637-ae64-47cb-9f5e-b863962bb3f6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:58.280028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:58.280622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:58.280903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:58.281175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:58.281829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:58.282132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:58.283542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:58.292227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 608/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:58.299196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.398472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44a-ab16-4dd3-b5ef-bfcd71af6954 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:58.423340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.431702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:58.432313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:58.432592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:58.432866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] PATH_INFO: `/v3/users/a29630a189bb433da2eff47a5c0321ad` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:58.433963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] RBAC: Authorizing `identity:get_user(user_id=a29630a189bb433da2eff47a5c0321ad)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:58.435420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:58.436959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 589/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Aug 30 16:05:58 2022] GET /identity/v3/users/a29630a189bb433da2eff47a5c0321ad => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:58.443478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.539814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921f52-1cfa-4172-a4d6-7a954342f203 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:58.572010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:58.572601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:58.572880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:58.573153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:58.587230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.638330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:58.639798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:58.734038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 609/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:05:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:58.740593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.838257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aff0-bba5-4747-b684-e9ad37b2e34f None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:58.872034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:58.872655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:58.872939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:58.873215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] PATH_INFO: `/v3/projects/4a388b87e6804d5997b65caaf0707fe2` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:58.874328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] RBAC: Authorizing `identity:get_project(project_id=4a388b87e6804d5997b65caaf0707fe2)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:58.875788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb8a6e-c1ed-4d60-a63a-ae797eb3146d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:58.877394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 590/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Aug 30 16:05:58 2022] GET /identity/v3/projects/4a388b87e6804d5997b65caaf0707fe2 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:05:58.883985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:05:58.927078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.980400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59abcf6-bf5c-40e0-b40b-302839cb884d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:05:59.013770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:05:59.014352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:05:59.014628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:05:59.014897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:05:59.015651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=4a388b87e6804d5997b65caaf0707fe2, user.id=a29630a189bb433da2eff47a5c0321ad) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:05:59.015956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:05:59.017370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601203-640b-4051-8d85-c3f308e3adeb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:05:59.022964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 610/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:05:58 2022] GET /identity/v3/role_assignments?user.id=a29630a189bb433da2eff47a5c0321ad&scope.project.id=4a388b87e6804d5997b65caaf0707fe2&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:06:08.867916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=68 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:09.020387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=46 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:54.337957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653bf96-12f7-48ab-8a14-a57282accc84 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:54.338634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653bf96-12f7-48ab-8a14-a57282accc84 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:54.338634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653bf96-12f7-48ab-8a14-a57282accc84 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:54.340025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 591/1201] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:06:54.345246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:54.345705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:54.345821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:54.367767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:54.368975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:54.461304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 611/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:06:54.737917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653bf96-12f7-48ab-8a14-a57282accc84 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:54.873812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653bf96-12f7-48ab-8a14-a57282accc84 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:54.925131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:54.925780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:54.926266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:54.926812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:54.942079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:54.943762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:06:54.963046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:54.964439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:06:54.965489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:06:54.965489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:54.965489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:06:54.965489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 592/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:54.971343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:55.094417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc46e8e-fdc5-4b17-acdb-b66783629322 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:55.131373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:55.139513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:55.140312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:55.140581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:55.140864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:55.141584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:06:55.141893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:55.143414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60608-5c81-44dd-9143-178d1f52e450 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:55.162278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 612/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:06:55.163489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:55.240004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:55.307020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae7b1-aa8a-437f-a691-4f156099b9e4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:55.355085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:55.356049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:55.356182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:55.356566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:55.357273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:55.359601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0eca9-d9da-4da0-96bb-3681c0b2e90e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:55.389412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 593/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Aug 30 16:06:55 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:06:57.521663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645a69-cf33-4e56-ad13-f22e231b6812 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:57.522247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645a69-cf33-4e56-ad13-f22e231b6812 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:57.522247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645a69-cf33-4e56-ad13-f22e231b6812 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:57.523902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 613/1206] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:06:57.530549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:57.531130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:57.531130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:57.550665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:06:57.552497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:06:57.625856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 594/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:06:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:06:57.899829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59645a69-cf33-4e56-ad13-f22e231b6812 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.010358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59645a69-cf33-4e56-ad13-f22e231b6812 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.053278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.053923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.054232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.054473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.065285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:06:58.070838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:58.072233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:06:58.073390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:06:58.077973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.079107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 614/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:06:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:58.121166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.191081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3deb7-2788-4ec4-b3ce-1bd153f21c2c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.229243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.229923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.230214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.230501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.231226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:06:58.231531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.233131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.242973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 595/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:06:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:06:58.249066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.304778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.360711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe7ed-ef5a-4d1a-90e9-4d958187182d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.396499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.397145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.397465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.397826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.413838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.415559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:06:58.434189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:58.435446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:06:58.436578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:06:58.436578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:58.436578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:06:58.436578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 615/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:58.441265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.554076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.560099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922179-125c-4f78-93cb-5ad225633ab2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.596712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.597417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.598294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.598715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.599554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:06:58.599926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.601772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.616903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 596/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:06:58.622584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.748317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93679c2-20bb-4fa7-ab16-040465474172 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:58.750380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.793511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:58.794439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:58.795028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:58.795484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:58.805549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:58.807378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:06:58.822916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:58.824165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:06:58.825359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:06:58.827316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 616/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:06:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:58.833649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:58.968809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c93a-50d4-491b-823c-11fcf7f9400d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.014208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.014719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.015213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.015457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.016198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:06:59.016546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.018057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.039228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 597/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:06:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:06:59.045332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:59.161505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff8b-4a5e-48e8-88d9-d752221c4e8d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.201286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.203148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.203148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.203148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.246456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.299753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.302353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.420251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 617/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:06:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:06:59.426294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:59.447695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.540144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed855c-0dbc-42f4-8009-8a1fe5412b36 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.583760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.584380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.584584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.584859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.597364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.598859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:06:59.615448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:59.616910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:06:59.617900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:06:59.617900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:06:59.617900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:06:59.617900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 598/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:59.622896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:59.694729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.737393 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72bcb4-30ca-434c-8c2a-24823ee99a4d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.777073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.777860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.778242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.778619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.779625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:06:59.780046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.781865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.795273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 618/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:06:59.801126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:06:59.889910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.926806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b859678-d40c-4ec5-89e4-ceff9d4a2f73 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:06:59.963378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:06:59.964171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:06:59.964309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:06:59.964570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:06:59.971996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:06:59.974205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:06:59.986690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:06:59.987918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:06:59.990136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 599/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:06:59.994861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:00.109414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1df-f384-4f90-ae74-254952923921 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:00.138911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:00.153431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:00.154028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:00.154310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:00.154609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:00.155335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:00.155633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:00.157058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac12-c169-44a0-8728-2f566991058d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:00.171434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 619/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:00.177961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:00.303565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30934e-0996-401b-8ac3-9f6efd9c8056 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:00.340144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:00.349932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:00.350558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:00.350842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:00.351154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:00.352326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=21d3e6537d3347e08b1e8460b5a5c152) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:00.352745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:00.354559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e359cdd-ed5a-42c5-a6c8-d14d1b57a295 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:00.362461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 600/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:07:00 2022] GET /identity/v3/role_assignments?user.id=21d3e6537d3347e08b1e8460b5a5c152&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:07:02.443611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a20-c5ee-4b9d-99e5-74926d67246a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:02.444167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a20-c5ee-4b9d-99e5-74926d67246a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:02.444167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a20-c5ee-4b9d-99e5-74926d67246a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:02.445668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 620/1220] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:02.452091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:02.452499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:02.452742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:02.472363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:02.474163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:02.549743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 601/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:02.831219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a20-c5ee-4b9d-99e5-74926d67246a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:02.945616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a20-c5ee-4b9d-99e5-74926d67246a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:02.979466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:02.980034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:02.980308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:02.980576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:02.990659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:07:02.995666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:02.996782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:02.997633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 621/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:07:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:03.003068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:03.107424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d91ce-e1ef-4d0e-8010-ceb3fb3821c7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:03.135494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:03.147641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:03.148378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:03.148667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:03.148994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:03.149757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:03.150099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:03.151898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:03.161296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 602/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:03.168205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:03.216615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:03.284284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023747-5aff-477b-a6a1-c9291fadb24a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:03.321900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:03.322566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:03.322881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:03.323216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:03.335451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:03.336913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:03.354483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:03.355666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:03.356713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:03.356713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:03.356713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:03.356713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 622/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:03.362144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:03.474413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf3cc4-2aea-4a60-b052-bc895774ffe2 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:03.512361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:03.513002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:03.513285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:03.513562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:03.514505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:03.514912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:03.516694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:03.531512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 603/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:03.538160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:03.643613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:03.651382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e59c8-f10d-4b0a-84db-c6087d03c31a None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:03.689940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:03.690614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:03.690888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:03.691235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:03.701374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:03.702919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:07:03.717292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:03.718571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:03.719885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 623/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:03.725968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:03.778728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:03.836849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13e6e-1e14-4f10-8aa7-29fbf76122e9 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:03.875680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:03.876279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:03.876558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:03.876825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:03.877543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:03.877844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:03.879859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:03.905156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 604/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:03.906214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:04.011255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56df894-5666-407b-b82d-cd68d68ba3c5 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:04.047648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:04.048278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:04.048559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:04.048830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:04.060827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:04.062281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:04.076536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:04.077994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:04.079155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:04.079155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:04.079155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:04.079155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 624/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:04.084473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:04.192582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96710d9a-f9bb-493d-8234-2313b3693441 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:04.194870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:04.240244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:04.241264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:04.241626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:04.241985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:04.242874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:04.243168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:04.244658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:04.257748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 605/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:04.266514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:04.279176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:04.377081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac58e-5e96-4ab7-84ce-9c27331bd5fb None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:04.415239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:04.415881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:04.416204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:04.416482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:04.423464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:04.425005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:07:04.437338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:04.438413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:04.439725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 625/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:04.445688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:04.559711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c4dc-6b6e-4872-9859-18fadfdef810 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:04.600111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:04.600732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:04.601008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:04.601292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:04.601987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:04.602298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:04.603761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c577-9095-4017-b354-b0fc3be0da6e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:04.616284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 606/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:07:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:04.622231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:04.693417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:04.731817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0014-8cab-42ca-878f-bf7308daf676 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:04.771302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:04.771993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:04.772319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:04.772635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/21d3e6537d3347e08b1e8460b5a5c152/roles/d860a566e6b643379c53befd5cd73823` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:04.787921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=21d3e6537d3347e08b1e8460b5a5c152, role_id=d860a566e6b643379c53befd5cd73823)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:04.789390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c346a-7cd3-47f8-bc63-b52cb2fd615b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:04.803015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 626/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:07:04 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/21d3e6537d3347e08b1e8460b5a5c152/roles/d860a566e6b643379c53befd5cd73823 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:07:06.753914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27959ac-d143-4d02-aa24-2f9c592a4a54 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:06.754538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27959ac-d143-4d02-aa24-2f9c592a4a54 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:06.754618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27959ac-d143-4d02-aa24-2f9c592a4a54 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:06.756013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 607/1233] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:06.761448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:06.761916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:06.762023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:06.780458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:06.781663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:06.858298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 627/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:07.166167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27959ac-d143-4d02-aa24-2f9c592a4a54 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:07.194070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:07.286293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27959ac-d143-4d02-aa24-2f9c592a4a54 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:07.323923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:07.324555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:07.324832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:07.325102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:07.336797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:07:07.341761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:07.342714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:07.343673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 608/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Aug 30 16:07:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:07.349175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:07.397435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:07.459645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219ec9-2279-40e1-b018-8c36460dc6e3 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:07.497068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:07.497680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:07.497998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:07.498225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:07.498907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] RBAC: Adding query filter params (name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:07.499280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:07.500794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:07.509327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 628/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Aug 30 16:07:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:07.515198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:07.606158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:07.623564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e49fef-ca8f-48a7-b361-07ea1e85471e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:07.661051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:07.661735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:07.662053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:07.662289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:07.673555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:07.675049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:07.690835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:07.697593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:07.698732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:07.698732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:07.698732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:07.698732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 609/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:07:07.699028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:07.808613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fca877-78c1-4a03-b83c-72a14d87813b None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:07.818518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:07.851771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:07.851771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:07.851771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:07.851771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:07.852164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:07.852164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:07.853226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:07.868472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 629/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:07.874258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:07.982097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdfb9-081b-40fe-ba36-b2d5358d8391 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:08.023375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:08.024069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:08.024350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:08.024622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:08.027762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:08.033785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:08.036191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:07:08.048926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:08.056415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:08.057611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 610/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 16:07:08.058357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:08.177249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefc8d-827f-4321-b3fa-bde380ce27e7 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:08.214759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:08.215565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:08.215884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:08.216378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:08.217259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:08.217806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:08.219671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:08.254462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 630/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:07:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:08.255825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:08.377427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f4cb-ec13-41dc-961c-2f681728e157 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:08.417347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:08.417972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:08.418231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:08.418503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:08.482365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:08.490459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:08.492288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:08.597938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 611/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:07:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:07:08.604291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:08.636034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:08.710636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58218c-ccdf-45d7-aa7e-a619c98bb773 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:08.746089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:08.746756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:08.747230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:08.747706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:08.759396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:08.761038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:08.777895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:08.779112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:08.780269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:08.780269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:08.780269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:08.780269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 631/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:08.785033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:08.911945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:08.918404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adce1-11a9-422b-beea-62802945d334 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:08.954473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:08.955112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:08.955395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:08.955712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:08.956353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:08.956741 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:08.959965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:08.971258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 612/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:08.977102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:09.062281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:09.091722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7290a1-8bf3-4c55-80d0-875e502de12d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:09.125900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:09.126519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:09.126794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:09.127092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:09.134822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:09.136430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:07:09.147852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:09.148959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:09.150224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 632/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:09.154876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:09.283197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b991c8-b14c-429e-b425-2093fc9ca362 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:09.318788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:09.319340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:09.319620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:09.319889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:09.320583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:09.320917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:09.322364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812629b6-7110-450c-ac23-0a111df85d9d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:09.335596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 613/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:09.341629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:09.447962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375755-e67b-45b0-b5f5-1484e1f2511d None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:09.483352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:09.483959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:09.484258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:09.484527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:09.485253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] RBAC: Adding query filter params (role.id=d860a566e6b643379c53befd5cd73823, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=21d3e6537d3347e08b1e8460b5a5c152) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:09.485561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:09.487009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5acc-9f93-4d8b-b4b2-0ef75308e6e7 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:09.493095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 633/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:07:09 2022] GET /identity/v3/role_assignments?user.id=21d3e6537d3347e08b1e8460b5a5c152&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=d860a566e6b643379c53befd5cd73823 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:11.526722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0efd-5be2-4020-978c-afbc6695632a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:11.527364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0efd-5be2-4020-978c-afbc6695632a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:11.527364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0efd-5be2-4020-978c-afbc6695632a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:11.528764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 614/1247] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:11.533923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:11.534381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:11.534500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:11.540895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:11.555390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:11.556847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:11.635736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 634/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:11.921549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0efd-5be2-4020-978c-afbc6695632a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:11.942010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:12.041080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0efd-5be2-4020-978c-afbc6695632a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.079199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.082676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.082676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.082676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.092194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:07:12.096973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:12.098168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:12.099155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 615/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:12.104568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:12.223955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1484bd-bcda-400e-8f8b-0914506af201 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.261852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:12.270213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.270952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.271153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.271452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.272194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:12.272519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:12.273999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:12.283480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 635/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:12.290152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:12.372962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:12.395841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08561-5bbf-4cea-ad52-6256100376e1 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.431117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.431744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.432043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.432291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.443860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:12.445328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:12.460510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:12.461525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:12.462426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:12.462426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:12.462426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:12.462426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 616/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:12.467687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:12.591499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba880-c595-4d7a-beab-b8539f9acb40 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.632854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.633470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.633754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.634038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.634743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:12.635107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:12.636645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:12.648416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 636/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:07:12.656165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:12.766801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3d39-9439-4394-8aa9-54e216d36425 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.793794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:12.802805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.803467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.803746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.804028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.811520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:12.812954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:07:12.824047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:12.825075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:12.826070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 617/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:12.831110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:12.893702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:12.947601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a330-0eee-44d5-a9a1-399b9c223e87 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:12.989305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:12.989970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:12.990260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:12.990519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:12.991524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:12.991826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:12.993336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:13.017268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 637/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:07:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:13.018616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:13.125087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836659a3-8c7d-4525-8e31-73b8dfbc2c1d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:13.163552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:13.164085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:13.164363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:13.164635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:13.221206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:13.238918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:13.241471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:13.365018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 618/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:07:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:07:13.371273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:13.477784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64840c55-c77d-4b71-8e30-ed3d612dc635 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:13.491947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:13.514792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:13.515454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:13.515734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:13.516004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:13.526996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:13.528473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:13.543792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:13.545170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:13.546447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:13.546447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:13.546447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:13.546447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 638/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:13.550716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:13.646791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:13.661524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb1afd-8983-40cb-aa48-f0ef949f9d82 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:13.698712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:13.699349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:13.699628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:13.699905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:13.700542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:13.700849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:13.702211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:13.713684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 619/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:13.719426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:13.842238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee475ce-c213-45ac-9a20-f1ea429e3456 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:13.881842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:13.882489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:13.882768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:13.883200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:13.890596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:13.892101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:07:13.904075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:13.905197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:13.906329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 639/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:13.913271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:14.020085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c519-b7bc-4714-94d8-face1aba1fcb None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:14.055266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:14.055888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:14.056170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:14.056444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:14.057184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:14.057491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:14.058972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d397b0-759c-4599-ac5f-59dbb5d289db None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:14.072406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 620/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:14.078687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:14.105797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:14.185055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a565c0b-8234-4957-82d6-bbcabbbfe9e3 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:14.219519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:14.220157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:14.220440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:14.220711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:14.221428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=21d3e6537d3347e08b1e8460b5a5c152) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:14.221768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:14.223867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6f90-9c33-4736-ae43-424fa1a51a9c None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:14.229539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 640/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:07:14 2022] GET /identity/v3/role_assignments?user.id=21d3e6537d3347e08b1e8460b5a5c152&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:07:16.141706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741593-5a83-45a5-9fc9-1ca6d06fd2ec None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.142203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741593-5a83-45a5-9fc9-1ca6d06fd2ec None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.142203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741593-5a83-45a5-9fc9-1ca6d06fd2ec None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.143520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 621/1261] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:16.149064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.149479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.149628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.168237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:16.169423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:16.239016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 641/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:16.519743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741593-5a83-45a5-9fc9-1ca6d06fd2ec None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:16.530443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:16.622800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741593-5a83-45a5-9fc9-1ca6d06fd2ec None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:16.656105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:16.656713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.656986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.657253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.667893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:07:16.672545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:16.673633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:16.674843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 622/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:16.679979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:16.697684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:16.775979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45153431-8ea7-4b35-b0b3-bc4a106b841a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:16.808597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:16.809185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.809463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.809733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.810386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:16.810686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:16.812077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:16.819860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 642/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:16.825489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:16.892498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:16.927245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412de99-f3b1-45b1-a246-c5d2eea12085 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:16.960734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:16.961346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:16.961623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:16.961892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:16.971591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:16.974015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:16.988301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:16.989358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:16.990573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:16.990573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:16.990573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:16.990573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 623/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:16.995428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.073598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:17.092367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca574c9-68d7-4870-bccf-a38d21d9c222 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.124309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.124893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.125168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.125433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.126060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:17.126356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.127731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.139543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 643/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:17.145622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.250678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cf3-2018-455b-90ce-432ec094b489 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.278314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:17.292725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.293409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.293693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.293991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.301457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.302897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:07:17.313748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:17.314843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:17.316699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 624/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:17.321211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.418291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21937-5730-4ba3-bdbf-4b6166aac29f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.451814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.452400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.452672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.452937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.453649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:17.453951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.455392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.463732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:17.471836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 644/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:17.477487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.574570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1605cec-dfb4-4ac4-a2c7-c4702fd32f9c None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.606596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.607238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.607518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.607830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.618925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.620365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:17.634803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:17.635918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:17.637198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:17.637198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:17.637198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:17.637198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 625/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:17.641571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.736599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f6b4-60f0-493e-9db4-8dc2f231b058 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.770242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.770840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.771155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.771431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.772067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:17.772373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.773737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.785283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 645/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:17.791012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:17.822372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:17.892483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655cbf-0ad8-4503-b363-dcea30ca8123 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:17.925090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:17.926511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:17.926786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:17.927153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:17.933485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:17.934905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:07:17.946135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:17.947210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:17.948446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 626/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:17.953075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:18.010899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:18.051806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655a9c-0eb3-405f-9c50-199f5cce6d7e None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:18.083751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:18.084340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:18.084617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:18.084889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:18.085571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:18.085875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:18.087326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616a04-0663-4938-b631-e2be10d34f72 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:18.100155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 646/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:18.106105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:18.197140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:18.208463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e23a-efdb-4592-a87b-305d23bc5469 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:18.250288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:18.251079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:18.251385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:18.251664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] PATH_INFO: `/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/21d3e6537d3347e08b1e8460b5a5c152/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:18.254219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e0060ba2a884a119c02bba06d8c4634, user_id=21d3e6537d3347e08b1e8460b5a5c152, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:18.255700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea936-0e29-4913-a115-7cb881437314 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:18.275734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 627/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Aug 30 16:07:18 2022] PUT /identity/v3/projects/5e0060ba2a884a119c02bba06d8c4634/users/21d3e6537d3347e08b1e8460b5a5c152/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:07:20.144745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb6e5c-39c8-498e-b735-a1bebc314c74 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:20.145292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb6e5c-39c8-498e-b735-a1bebc314c74 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:20.145292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb6e5c-39c8-498e-b735-a1bebc314c74 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:20.146530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 647/1274] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:20.151614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:20.152035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:20.152155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:20.170207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:20.171417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:20.236170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 628/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:20.501446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb6e5c-39c8-498e-b735-a1bebc314c74 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:20.601564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb6e5c-39c8-498e-b735-a1bebc314c74 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:20.618179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:20.634179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:20.634790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:20.635092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:20.635364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:20.645492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 16:07:20.650142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:20.651319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:20.652242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 648/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Aug 30 16:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:20.657215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:20.736840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:20.756552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4c8d-db64-4bf6-b8cd-f714dcafe283 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:20.789527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:20.790122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:20.790401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:20.790672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:20.791357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:20.791659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:20.793013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:20.800811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 629/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Aug 30 16:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:20.806388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:20.904979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa63f-18d8-40d8-a801-2d8dc1f1b54f None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:20.937461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:20.938076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:20.938354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:20.938626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:20.949408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:20.952061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:20.971442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:20.973058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:20.974192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:20.974192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:20.974192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:20.974192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 649/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:20.978411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:21.075522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5041a-e0b3-4db9-9740-e276d4453bf3 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:21.107304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:21.107890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:21.108168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:21.108438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:21.109068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:21.109368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:21.110714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:21.122899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 630/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:21.129013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:21.158707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.227665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff88d1-ec1f-44b0-a4f6-0fddde8f9a20 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:21.270743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:21.271403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:21.271682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:21.271958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:21.279465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:21.280900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 16:07:21.292026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:21.293160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:21.294513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 650/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:21.298912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:21.303449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.396207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aebd-16f1-4559-9cd9-54a2e7fd595e None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:21.428765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:21.429364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:21.429646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:21.429919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:21.430640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:21.430945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:21.432430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:21.449374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 631/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Aug 30 16:07:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:21.455126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:21.542631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.553282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558011-1dbc-4878-845a-00d677f01b14 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:21.585116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:21.585711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:21.585991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:21.586262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:21.651539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:21.653028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:21.738176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.748879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 651/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Aug 30 16:07:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 16:07:21.754727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:21.815356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.854034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26993-9c9e-4abe-8788-e248e73414e4 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:21.890039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:21.890657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:21.890938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:21.891246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:21.901508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:21.903023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 16:07:21.917782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:21.918921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 16:07:21.920038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 16:07:21.920038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 16:07:21.920038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:21.920038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 632/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:21.924668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:22.022427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168f7b-691f-4556-95d5-adf745f11ebd None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:22.055880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:22.056559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:22.056842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:22.057111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:22.057733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:22.058031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:22.059420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:22.070958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 652/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Aug 30 16:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:22.077387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:22.174325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec7a5-7dba-413f-8fe8-8b435578ab64 None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:22.187363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:22.207873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:22.208490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:22.208773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:22.209047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:22.215493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:22.216928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 16:07:22.229104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:22.230066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: ERROR keystone.server.flask.application Aug 30 16:07:22.232039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 633/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Aug 30 16:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:22.236499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:22.291455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:22.340478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f4881-d0d4-4b33-bb4c-b62df052fd20 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:22.372441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:22.373035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:22.373312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:22.373579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:22.374252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:22.374552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:22.376061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f949c-e278-4849-96b5-3c461c200d4f None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:22.388077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 653/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Aug 30 16:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:22.394807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:22.492244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae17-ec9d-4512-a4f7-56b57b9a753d None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:22.525112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:22.525698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:22.525980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:22.526252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:22.526971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] RBAC: Adding query filter params (role.id=7a972f46fd9e4eab9286affd0bccd548, scope.project.id=5e0060ba2a884a119c02bba06d8c4634, user.id=21d3e6537d3347e08b1e8460b5a5c152) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:22.527309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:22.528738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932d65-3633-4618-9757-fd405a09d616 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:22.534363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 634/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Aug 30 16:07:22 2022] GET /identity/v3/role_assignments?user.id=21d3e6537d3347e08b1e8460b5a5c152&scope.project.id=5e0060ba2a884a119c02bba06d8c4634&role.id=7a972f46fd9e4eab9286affd0bccd548 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:24.452549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9495a-880b-41e3-b5d4-11ba5281ff04 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:24.453077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9495a-880b-41e3-b5d4-11ba5281ff04 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:24.453077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9495a-880b-41e3-b5d4-11ba5281ff04 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:24.454465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 654/1288] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:24.460042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:24.460462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:24.460604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:24.478407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:24.479628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:24.509293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:24.546782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 635/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:24.813179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9495a-880b-41e3-b5d4-11ba5281ff04 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:24.916603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9495a-880b-41e3-b5d4-11ba5281ff04 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:24.926992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:24.949774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:24.950394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:24.950672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:24.950942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:24.951552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:24.952919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:24.962108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:24.963195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:24.964151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 655/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:07:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:24.969252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:25.068699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60870-9ec8-4b74-a06b-b9ec9df1b9cc None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:25.102130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:25.102727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:25.103030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:25.103310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:25.103933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:25.104236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:25.105598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da5f6e-15ca-4d81-af50-c60858a83e08 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:25.110238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 636/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Aug 30 16:07:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:25.116459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:25.214410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0589-7a35-4c49-bbb2-69655cdad6aa None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:25.258052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:25.258934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:25.259445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:25.259792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] PATH_INFO: `/v3/services` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:25.260748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:25.261208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:25.263034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d498e4c-f358-495c-9af7-e8153c0b787a None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:25.270740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 656/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Aug 30 16:07:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:27.205343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68da3-f720-4486-a712-20bbb5a0c16f None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:27.206387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68da3-f720-4486-a712-20bbb5a0c16f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:27.206500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68da3-f720-4486-a712-20bbb5a0c16f None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:27.208089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 637/1293] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:27.213229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b9f8b-d11b-4c34-befe-07699dea808c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:27.213608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b9f8b-d11b-4c34-befe-07699dea808c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:27.213774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b9f8b-d11b-4c34-befe-07699dea808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:27.233844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9b4b9f8b-d11b-4c34-befe-07699dea808c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:27.235211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9b4b9f8b-d11b-4c34-befe-07699dea808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:27.264184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.300855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 657/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:27.570119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68da3-f720-4486-a712-20bbb5a0c16f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:27.600948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.669233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68da3-f720-4486-a712-20bbb5a0c16f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:27.701798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:27.702392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:27.702669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:27.702940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:27.703613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:27.704985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58538-a58d-4c2b-ad27-1c1635149c40 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:27.719566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 638/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Aug 30 16:07:27 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:07:29.621580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9daa6-6b6e-45a5-8cae-01c1296af48b None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:29.622131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9daa6-6b6e-45a5-8cae-01c1296af48b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:29.622131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9daa6-6b6e-45a5-8cae-01c1296af48b None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:29.623486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 658/1296] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:29.628843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:29.629285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:29.629408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:29.647705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:29.648912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:29.718948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 639/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:29.991322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9daa6-6b6e-45a5-8cae-01c1296af48b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:30.089460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9daa6-6b6e-45a5-8cae-01c1296af48b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:30.122090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:30.122704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:30.123009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:30.123275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:30.123848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:30.125210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:30.133888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:30.135110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:30.136173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 659/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:07:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:30.140979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:30.160176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:30.242707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04f5b-6770-494a-87de-025007b3d87d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:30.275370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:30.275966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:30.276242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:30.276536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:30.277154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:30.277452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:30.278802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:30.283827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 640/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Aug 30 16:07:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:30.290643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:30.321134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:30.388242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1dbef-2cec-4e4c-8982-fdfe3f037f97 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:30.421809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:30.422396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:30.422675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:30.422946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:30.423662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] RBAC: Adding query filter params (interface=public, service_id=6e7e1a6824554125a32839524d86d066, region_id=RegionOne) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:30.423970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:30.425396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7964-05b2-408f-99f7-ca95fb3955c6 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:30.430274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 660/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Aug 30 16:07:30 2022] GET /identity/v3/endpoints?service_id=6e7e1a6824554125a32839524d86d066&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:30.435885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:30.515957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:30.533777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abf37-ccee-4d7b-af3a-d60e1918abcd None admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:30.567390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:30.567987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:30.568267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:30.568542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:30.569140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:30.570497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803f90-b17a-480d-9df6-2004e4cd0039 None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:30.577372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 641/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Aug 30 16:07:30 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:07:32.467608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580846e-0a41-41d0-a45e-0e74743fffd2 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:32.468135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580846e-0a41-41d0-a45e-0e74743fffd2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:32.468135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580846e-0a41-41d0-a45e-0e74743fffd2 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:32.469471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 661/1302] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:07:32.475598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:32.475994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:32.476136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:32.494334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:07:32.495556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:07:32.560748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 642/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:07:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 16:07:32.826205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580846e-0a41-41d0-a45e-0e74743fffd2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:32.919711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:32.926685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580846e-0a41-41d0-a45e-0e74743fffd2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:32.959677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:32.960295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:32.960576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:32.960846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:32.961421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:32.962779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 16:07:32.971381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 16:07:32.972377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application with Lock( Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self._enter() Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application return self.creator() Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application created_value = creator( Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: ERROR keystone.server.flask.application Aug 30 16:07:32.973307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 662/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Aug 30 16:07:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 16:07:32.978718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:33.055044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:33.084575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f10177-b7db-4fa5-b35b-ed6ca2fc75f7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:33.118751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:33.119388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:33.119672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:33.119945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] PATH_INFO: `/v3/services` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:33.120572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:07:33.120875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:33.122244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717359-5176-45c0-b157-988d0881a3ab None admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:33.127309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 643/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Aug 30 16:07:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:07:33.133187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:07:33.232057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6741a-70c0-40a6-a8a6-cb48ec49e639 None admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:07:33.272233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:07:33.273449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:07:33.273767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:07:33.274163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:07:33.274830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:07:33.276821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c03a39-7a75-4914-9c24-376f40d69a03 None admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:07:33.302923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 663/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:07:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:07:43.124455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=30 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:43.298061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:37.107657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a497-6453-4d27-ab10-d14e1ae8621e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:37.108120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a497-6453-4d27-ab10-d14e1ae8621e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:37.108214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a497-6453-4d27-ab10-d14e1ae8621e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:37.113641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 644/1307] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:37.115323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556943-abe6-48e2-877f-30e6c030f567 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:37.116003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556943-abe6-48e2-877f-30e6c030f567 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:37.116291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556943-abe6-48e2-877f-30e6c030f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:37.257161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-53556943-abe6-48e2-877f-30e6c030f567 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:37.258775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-53556943-abe6-48e2-877f-30e6c030f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:37.423040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 664/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:08:37.723611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:37.724295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:37.724791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:37.726830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 645/1309] 10.222.0.30 () {54 vars in 965 bytes} [Tue Aug 30 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:37.733082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bd48-fa11-4d1c-99f8-e48659c92de6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:37.733410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bd48-fa11-4d1c-99f8-e48659c92de6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:37.733632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9bd48-fa11-4d1c-99f8-e48659c92de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:37.824162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-26a9bd48-fa11-4d1c-99f8-e48659c92de6 None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:37.825391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-26a9bd48-fa11-4d1c-99f8-e48659c92de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:37.856427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:37.913755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 665/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Tue Aug 30 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:08:37.922794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:37.924581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:38.046291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5c9d5-c520-4caa-b889-05c78ed65c62 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:38.124448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:38.125129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:38.125598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:38.125598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:38.127245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:38.183837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:38.250591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:38.252078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e81c-1871-4f8b-a9db-7ead9e626ac0 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:38.271107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 646/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:08:40.475391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:40.475913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:40.475913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:40.477416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 666/1312] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:40.482393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1913-7e32-48f2-8d26-b7a7271bd972 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:40.482844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1913-7e32-48f2-8d26-b7a7271bd972 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:40.482927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1913-7e32-48f2-8d26-b7a7271bd972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:40.568573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-fc6f1913-7e32-48f2-8d26-b7a7271bd972 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:40.569789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fc6f1913-7e32-48f2-8d26-b7a7271bd972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:40.679986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 647/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:40.966263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:40.967880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:41.073669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b658e-fbc0-4ea9-82f2-ffa3502e7a40 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:41.148588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:41.151408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:41.152266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:41.152746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:41.153179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:41.154838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:41.267344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:41.268819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43059d1-96fd-4e81-8c04-6e8002dd241d service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:41.286319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 667/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:43.486221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:43.486758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:43.486758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:43.488116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 648/1315] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:43.493362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe57a-943a-49bf-8d02-0cb5db2f5496 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:43.493803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe57a-943a-49bf-8d02-0cb5db2f5496 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:43.493937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe57a-943a-49bf-8d02-0cb5db2f5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:43.559419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-dedbe57a-943a-49bf-8d02-0cb5db2f5496 None None] MFA Rules not processed for user `2ae94bd7829d48f986b6dcc7bf1299ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:43.560623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dedbe57a-943a-49bf-8d02-0cb5db2f5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:43.611943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:43.656030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 668/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:43.945313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:43.946852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:43.957260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:44.052062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575af7c5-d37d-4f68-a840-978b10bcbbe0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:44.125660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:44.126125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:44.126397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:44.126664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:44.128281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:44.189176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:44.236703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:44.238147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b248-527d-470a-af53-e994fbda189b service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:44.256984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 649/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:46.814874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:46.815449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:46.815449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:46.816778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 669/1318] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:46.821923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833a16-7d96-45b3-87ed-4158ff5d16e9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:46.822391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833a16-7d96-45b3-87ed-4158ff5d16e9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:46.822493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833a16-7d96-45b3-87ed-4158ff5d16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:46.888871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-53833a16-7d96-45b3-87ed-4158ff5d16e9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:46.890577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-53833a16-7d96-45b3-87ed-4158ff5d16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:46.984483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 650/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:47.268056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:47.269627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:47.371027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471b63-77f5-42b9-9975-eab6b1e93ed6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:47.442494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:47.443120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:47.443399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:47.443669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:47.445254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:47.452558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:47.552234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:47.553588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280f3a-e213-459f-a1b3-d6df4ae8475e service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:47.571925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 670/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:50.156688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:50.157254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:50.157254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:50.158491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 651/1321] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:50.163684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62b180-a707-4311-b916-c5be4fc955d4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:50.164118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62b180-a707-4311-b916-c5be4fc955d4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:50.164216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62b180-a707-4311-b916-c5be4fc955d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:50.232120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-aa62b180-a707-4311-b916-c5be4fc955d4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:50.233338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-aa62b180-a707-4311-b916-c5be4fc955d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:50.295500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:50.334949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 671/1322] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:50.626131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:50.627843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:50.647907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:50.731698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ce48-b524-41be-a6fd-8e8e9909969b None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:50.805926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:50.806433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:50.806714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:50.807009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:50.808616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:50.882602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:50.920775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:50.923255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311e55b-bc3d-4dd7-8a81-284bcd60ddbc service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:50.941237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 652/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:52.911183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:52.911760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:52.911760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:52.913127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 672/1324] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:52.918077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65be3e-8e8a-465b-b89d-ea4bbae06428 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:52.918494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65be3e-8e8a-465b-b89d-ea4bbae06428 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:52.918763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65be3e-8e8a-465b-b89d-ea4bbae06428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:52.987114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ec65be3e-8e8a-465b-b89d-ea4bbae06428 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:52.988327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ec65be3e-8e8a-465b-b89d-ea4bbae06428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:53.086621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 653/1325] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:53.368199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:53.369816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:53.479855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7ec28-74bb-441f-8904-37c079846a78 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:53.553311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:53.553908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:53.554181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:53.554447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:53.556073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:53.573022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:53.666810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:53.668277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ba0e8-c715-4756-a0d5-6a75c000a7b0 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:53.686403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 673/1326] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:55.640462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:55.640951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:55.641043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:55.642321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 654/1327] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:55.647922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafb08-bde3-4571-99b9-c0c027a043be None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:55.648378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafb08-bde3-4571-99b9-c0c027a043be None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:55.648531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafb08-bde3-4571-99b9-c0c027a043be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:55.721157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6aeafb08-bde3-4571-99b9-c0c027a043be None None] MFA Rules not processed for user `2ae94bd7829d48f986b6dcc7bf1299ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:55.722357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6aeafb08-bde3-4571-99b9-c0c027a043be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:55.787715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:55.820349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 674/1328] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:56.109669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:56.111434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:56.145857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:56.222465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8851a-76b3-4f22-8d25-af2e26dc1450 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:56.294686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:56.295331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:56.295615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:56.296266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:56.297539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:56.376024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:56.407873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:56.409325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bffd0f-19b1-423f-83ac-39d7477b97fb service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:56.427732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 655/1329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:58.607000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:58.607516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:58.607624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:58.609507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 675/1330] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:08:58.614878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715909-304f-408b-b5b1-0069533c14e1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:58.615310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715909-304f-408b-b5b1-0069533c14e1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:58.615843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715909-304f-408b-b5b1-0069533c14e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:58.683523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-33715909-304f-408b-b5b1-0069533c14e1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:08:58.684910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-33715909-304f-408b-b5b1-0069533c14e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:58.785730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 656/1331] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:08:59.072252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:08:59.073799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:59.178867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a057f9-7135-4d55-a2cb-dbf7c3c3f30e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:08:59.250409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:08:59.251028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:08:59.251308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:08:59.251573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:08:59.253147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:08:59.279336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:59.362197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:08:59.363667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ef2bb-476c-4435-a9d1-d3941ddd9d51 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:08:59.381693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 676/1332] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:01.336570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:01.337150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:01.337150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:01.338426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 657/1333] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:01.343545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99512-8c8b-48b7-80f5-10a5757b9f42 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:01.343939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99512-8c8b-48b7-80f5-10a5757b9f42 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:01.344088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99512-8c8b-48b7-80f5-10a5757b9f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:01.409390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b3a99512-8c8b-48b7-80f5-10a5757b9f42 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:01.410583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b3a99512-8c8b-48b7-80f5-10a5757b9f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:01.483826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:01.507044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 677/1334] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:01.789573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:01.791178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:01.830926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:01.896171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530184-3bd8-4703-a5c8-0abb5f7a72ee None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:01.970988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:01.971617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:01.971897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:01.972170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:01.973779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:02.057348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:02.083991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:02.085468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e56e4-8164-43e9-a7b2-3188e90a1a22 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:02.103177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 658/1335] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:04.346499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:04.347088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:04.347088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:04.348422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 678/1336] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:04.353714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3426c7e-4dcb-42be-b83b-c8884ce2e43b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:04.354122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3426c7e-4dcb-42be-b83b-c8884ce2e43b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:04.354261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3426c7e-4dcb-42be-b83b-c8884ce2e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:04.420346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b3426c7e-4dcb-42be-b83b-c8884ce2e43b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:04.422041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b3426c7e-4dcb-42be-b83b-c8884ce2e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:04.516895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 659/1337] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:04.798167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:04.799735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:04.901009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789a29-635e-477b-95cc-5c6b00bf0083 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:04.971907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:04.972498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:04.972774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:04.973043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:04.974604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:05.009398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:05.083098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:05.084485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc873f98-998c-4a61-8d44-ae75aead0b70 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:05.103167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 679/1338] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:08.915232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1a44-42ad-43f9-b529-efa835d674b5 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:08.915684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1a44-42ad-43f9-b529-efa835d674b5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:08.915767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1a44-42ad-43f9-b529-efa835d674b5 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:08.917245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 660/1339] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:08.923367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a9a-215b-4428-b4ed-f4eb24484238 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:08.923828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a9a-215b-4428-b4ed-f4eb24484238 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:08.923931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a9a-215b-4428-b4ed-f4eb24484238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:08.999937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-766b6a9a-215b-4428-b4ed-f4eb24484238 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:09.001173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-766b6a9a-215b-4428-b4ed-f4eb24484238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:09.088978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:09.101682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 680/1340] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:09.416039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:09.416325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:09.416597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:09.417958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 661/1341] 10.222.0.30 () {54 vars in 965 bytes} [Tue Aug 30 16:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:09.424313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5982-0c03-4d57-8d27-f4f2c79b7ebf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:09.424601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5982-0c03-4d57-8d27-f4f2c79b7ebf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:09.424879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5982-0c03-4d57-8d27-f4f2c79b7ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:09.503196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9bcd5982-0c03-4d57-8d27-f4f2c79b7ebf None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:09.504401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9bcd5982-0c03-4d57-8d27-f4f2c79b7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:09.578782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 681/1342] 10.222.0.30 () {58 vars in 1062 bytes} [Tue Aug 30 16:09:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:09.587873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:09.589424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:09.638094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:09.693924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43656f20-7392-47ac-892f-bfa74d071653 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:09.767372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:09.767988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:09.768266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:09.768540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:09.770137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:09.864099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:09.881439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:09.882883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374fa4-3486-4047-a4fd-d0af62663663 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:09.901376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 662/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:13.001724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:13.002301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:13.002301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:13.003632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 682/1344] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:13.008782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91522-ad09-4df3-9b1c-eddca22215eb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:13.009271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91522-ad09-4df3-9b1c-eddca22215eb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:13.009365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91522-ad09-4df3-9b1c-eddca22215eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:13.074546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-84b91522-ad09-4df3-9b1c-eddca22215eb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:13.075776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-84b91522-ad09-4df3-9b1c-eddca22215eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:13.174484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 663/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:13.462248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:13.463315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:13.552142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:13.568566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafbeaf-0904-4fcd-8b4a-3d986cfe90b4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:13.667339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:13.668276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:13.668759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:13.669102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:13.671431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:13.786638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:13.788149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed28dd-8003-4c7b-8ebe-ee58a5d56a11 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:13.807614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 683/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:17.784011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:17.784533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:17.784647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:17.785907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 664/1347] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:17.791271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014aac-2f8c-4530-aff6-6742ad0b5a8c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:17.791697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014aac-2f8c-4530-aff6-6742ad0b5a8c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:17.791931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014aac-2f8c-4530-aff6-6742ad0b5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:17.808215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:17.865784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7f014aac-2f8c-4530-aff6-6742ad0b5a8c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:17.867102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7f014aac-2f8c-4530-aff6-6742ad0b5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:17.967555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 684/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:18.256029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:18.257632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:18.315659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:18.361601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9b27-daaf-40d9-ab15-3136508e22e0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:18.433199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:18.433807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:18.434088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:18.434361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:18.436524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:18.540638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:18.545204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:18.546743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d355b5-4671-41e8-8e01-0a72ec8d51f9 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:18.564613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 665/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:23.493475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166ecb-c238-4185-aa76-95bba4624f8a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:23.493979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166ecb-c238-4185-aa76-95bba4624f8a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:23.494079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166ecb-c238-4185-aa76-95bba4624f8a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:23.495866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 685/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:23.501755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422a8f-880f-4cc6-a100-5fa93b592316 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:23.502190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422a8f-880f-4cc6-a100-5fa93b592316 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:23.502373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422a8f-880f-4cc6-a100-5fa93b592316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:23.606565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-55422a8f-880f-4cc6-a100-5fa93b592316 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:23.619027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-55422a8f-880f-4cc6-a100-5fa93b592316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:23.783228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 666/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:27.871732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7550-ac99-4919-8007-d7dafb914a00 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:27.872254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7550-ac99-4919-8007-d7dafb914a00 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:27.872254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7550-ac99-4919-8007-d7dafb914a00 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:27.874555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 686/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:27.879567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76332-cc4c-4f0a-b7d6-c93839cf3791 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:27.880058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76332-cc4c-4f0a-b7d6-c93839cf3791 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:27.880333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76332-cc4c-4f0a-b7d6-c93839cf3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:27.936764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:27.960516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e8a76332-cc4c-4f0a-b7d6-c93839cf3791 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:27.961871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e8a76332-cc4c-4f0a-b7d6-c93839cf3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:27.965184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=59 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:28.073474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 667/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:09:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:29.488164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db033a46-343d-4e39-9291-7b3dce69b9e3 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:29.488752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db033a46-343d-4e39-9291-7b3dce69b9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:29.488847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db033a46-343d-4e39-9291-7b3dce69b9e3 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:29.490435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 687/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:29.495477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325aa36-f5a7-4c10-a0a2-76bd57b652d1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:29.495882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325aa36-f5a7-4c10-a0a2-76bd57b652d1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:29.496152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325aa36-f5a7-4c10-a0a2-76bd57b652d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:29.574074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f325aa36-f5a7-4c10-a0a2-76bd57b652d1 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:29.575298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f325aa36-f5a7-4c10-a0a2-76bd57b652d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:29.619148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:29.684101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 668/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:32.988184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a6-9b43-4ff3-9682-e37d034a0e77 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:32.988718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a6-9b43-4ff3-9682-e37d034a0e77 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:32.988718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a6-9b43-4ff3-9682-e37d034a0e77 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:32.990323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 688/1356] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:32.995767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c14d-33d9-4531-98c4-512b8ab7cd35 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:32.996182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c14d-33d9-4531-98c4-512b8ab7cd35 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:32.996319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c14d-33d9-4531-98c4-512b8ab7cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.089774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6e81c14d-33d9-4531-98c4-512b8ab7cd35 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:33.091612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6e81c14d-33d9-4531-98c4-512b8ab7cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.216892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 669/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:33.519961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.520813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.521306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.523531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 689/1358] 10.222.0.30 () {54 vars in 962 bytes} [Tue Aug 30 16:09:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:33.532070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0424-142b-4188-811b-961ab81408b6 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:33.532755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0424-142b-4188-811b-961ab81408b6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:33.533259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0424-142b-4188-811b-961ab81408b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:33.553324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:33.629110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-49de0424-142b-4188-811b-961ab81408b6 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:33.630450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-49de0424-142b-4188-811b-961ab81408b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.764791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 670/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Aug 30 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:33.773043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:33.774731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:33.928682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c12dd-126f-4ed5-82c0-aebae153a76c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:34.024410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:34.069773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:34.070546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:34.070920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:34.075337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:34.077003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:34.172592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:34.174195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8f29-9aff-43a2-be13-9dad4e31207e service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:34.192741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 690/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:36.335884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:36.336394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:36.336394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:36.338186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 671/1361] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:36.344301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36eab5-2f2e-4759-89e8-121b7ae0634d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:36.344746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36eab5-2f2e-4759-89e8-121b7ae0634d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:36.344830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36eab5-2f2e-4759-89e8-121b7ae0634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:36.413005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bd36eab5-2f2e-4759-89e8-121b7ae0634d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:36.414201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bd36eab5-2f2e-4759-89e8-121b7ae0634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:36.456849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:36.532838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 691/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:36.823201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:36.824721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:36.902526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:36.990860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9c3a-0ca5-4025-b422-a090819bdc48 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:37.113460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:37.114142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:37.114424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:37.114713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:37.116560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:37.146921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:37.225424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:37.227061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f3d9-95a7-43e1-bc1b-1492b7b1fb82 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:37.253959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 672/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:39.505443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c81e-0f7a-4d57-9c6a-60cbc84d8f67 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:39.506362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c81e-0f7a-4d57-9c6a-60cbc84d8f67 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:39.506637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c81e-0f7a-4d57-9c6a-60cbc84d8f67 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:39.508018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 692/1364] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:39.514448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5898b-24c2-48d2-a6c3-5e7546951f12 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:39.514921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5898b-24c2-48d2-a6c3-5e7546951f12 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:39.515143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5898b-24c2-48d2-a6c3-5e7546951f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:39.594476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bac5898b-24c2-48d2-a6c3-5e7546951f12 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:39.595703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bac5898b-24c2-48d2-a6c3-5e7546951f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:39.704993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:39.719031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 673/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:40.000494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:40.000785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:40.001063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:40.002522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 693/1366] 10.222.0.30 () {54 vars in 962 bytes} [Tue Aug 30 16:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:40.007860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dfee-568a-49a9-a024-41ac30575f99 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:40.008645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dfee-568a-49a9-a024-41ac30575f99 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:40.008929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dfee-568a-49a9-a024-41ac30575f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:40.094697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-71e1dfee-568a-49a9-a024-41ac30575f99 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:40.095857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-71e1dfee-568a-49a9-a024-41ac30575f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:40.219551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 674/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Aug 30 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:40.227518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:40.229039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:40.406469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebe6e3-119b-43ac-9696-a8234e57f41b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:40.427922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:40.525598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:40.526272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:40.526500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:40.526738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:40.528390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:40.628460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:40.630390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387d0e-de2c-4d09-81ed-21d57140b5b0 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:40.650066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 694/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:41.227989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5842e6-8cc3-4357-bd30-3178c4ea3abb None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:41.228547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5842e6-8cc3-4357-bd30-3178c4ea3abb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:41.228547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5842e6-8cc3-4357-bd30-3178c4ea3abb None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:41.229920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 675/1369] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:41.235977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1ff07-a92b-4b69-91f2-8db6fbddf720 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:41.236270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1ff07-a92b-4b69-91f2-8db6fbddf720 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:41.236548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1ff07-a92b-4b69-91f2-8db6fbddf720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:41.272091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:41.309302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b2c1ff07-a92b-4b69-91f2-8db6fbddf720 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:41.310689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b2c1ff07-a92b-4b69-91f2-8db6fbddf720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:41.413409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 695/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:42.022162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.022162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.022162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.024805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 676/1371] 10.222.0.30 () {54 vars in 964 bytes} [Tue Aug 30 16:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:42.030248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b0ae-43e2-46e3-af9d-45642d6ad46c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.030727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b0ae-43e2-46e3-af9d-45642d6ad46c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.030882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b0ae-43e2-46e3-af9d-45642d6ad46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.109719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2711b0ae-43e2-46e3-af9d-45642d6ad46c None None] MFA Rules not processed for user `dc6e7b66794e4416ba15562e47e9888f`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:42.110832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2711b0ae-43e2-46e3-af9d-45642d6ad46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.157948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.188594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 696/1372] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:42.195977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:42.197484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.251335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.309680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff727-fc82-4bac-803b-c38b7d110f56 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:42.395425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:42.396204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.396663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.396991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.398929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.510567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.525487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:42.526848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd86f3-a0d0-4ae9-8113-31422aadb913 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:42.547254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 677/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:42.648599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.648890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.649164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.650874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 697/1374] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:09:42.656043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821f19-89e3-4438-a56c-ed7d40c05a02 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:42.656200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821f19-89e3-4438-a56c-ed7d40c05a02 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:42.656640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821f19-89e3-4438-a56c-ed7d40c05a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:42.738944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f8821f19-89e3-4438-a56c-ed7d40c05a02 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:42.740555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f8821f19-89e3-4438-a56c-ed7d40c05a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:42.838479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 678/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:43.129940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:43.131610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:43.285050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd1539-5e4e-44a3-8e8f-c08da8296fa9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:43.335188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.397942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:43.398488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:43.398767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:43.399094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:43.400714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:43.490554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:43.492171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa499-e51b-4e81-a7be-65d1dbf5d356 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:43.510392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 698/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:45.468384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.468935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.468935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.470250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 679/1377] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:45.475381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0730951-c1a0-4f42-a252-9048db22a019 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:45.475798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0730951-c1a0-4f42-a252-9048db22a019 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:45.475941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0730951-c1a0-4f42-a252-9048db22a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:45.546933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e0730951-c1a0-4f42-a252-9048db22a019 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:45.548163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e0730951-c1a0-4f42-a252-9048db22a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:45.554730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:45.675597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 699/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:45.967472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:45.971753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.047163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:46.175859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f6850-49a6-4b61-9a9a-3e907403ddb8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:46.311829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:46.312626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:46.313975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:46.313975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:46.315832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:46.342103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:46.431407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:46.433160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c0f2-ab44-4e1c-88c8-bb3b188e610d service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:46.454582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 680/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:48.416737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.417281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.417281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.419381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 700/1380] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:48.424637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2471-e55f-41d8-9c69-a5860c040442 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:48.425093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2471-e55f-41d8-9c69-a5860c040442 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:48.425189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2471-e55f-41d8-9c69-a5860c040442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:48.493849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b05c2471-e55f-41d8-9c69-a5860c040442 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:48.495068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b05c2471-e55f-41d8-9c69-a5860c040442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:48.601716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.614633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 681/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:48.906418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:48.907970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:49.071836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:49.084335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52c7a-a331-4c43-bb82-fef199375934 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:49.207220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:49.207920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:49.208266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:49.208606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:49.210241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:49.314092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:49.315863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f9df-40c3-4663-a5f4-013d49f5d09a service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:49.327630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:49.338025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 701/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:51.278392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.279157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.279157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.280330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 682/1383] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:51.285451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e652-72af-4e61-b1f3-69321588f362 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:51.285888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e652-72af-4e61-b1f3-69321588f362 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:51.285982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e652-72af-4e61-b1f3-69321588f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:51.354619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2956e652-72af-4e61-b1f3-69321588f362 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:51.355897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2956e652-72af-4e61-b1f3-69321588f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:51.463416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 702/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:51.748432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:51.749957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:51.901442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3103-05a1-46ec-8962-479743ac18f3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:51.971472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:52.019380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:52.019869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:52.020155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:52.020435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:52.022057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:52.117628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:52.119848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed92f07-9bfa-4a7e-8711-df3a055b3d57 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:52.141651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 683/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:54.088471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.089069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.089069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.090514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 703/1386] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:54.097591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addce83-1b23-4e71-a477-c417993e4bc7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.098068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addce83-1b23-4e71-a477-c417993e4bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.098327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addce83-1b23-4e71-a477-c417993e4bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.181072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9addce83-1b23-4e71-a477-c417993e4bc7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:54.182667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9addce83-1b23-4e71-a477-c417993e4bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.224484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:54.295479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 684/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:54.590217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:54.592467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.692362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:54.764595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0478785-4d74-46fe-8975-1ee028a8fd15 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:54.888283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:54.888897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:54.889181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:54.889459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:54.891112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:54.931469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:54.985371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:54.987012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50c99a-7420-4886-8114-20bf2d86d136 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:55.005663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 704/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:57.069126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.069694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.069821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.071191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 685/1389] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:57.076686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072c97-0502-4761-b10c-77f7f36c59c1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.077112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072c97-0502-4761-b10c-77f7f36c59c1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.077245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072c97-0502-4761-b10c-77f7f36c59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.143698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-58072c97-0502-4761-b10c-77f7f36c59c1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:57.144906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-58072c97-0502-4761-b10c-77f7f36c59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.245917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 705/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:57.536626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:57.538198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.663481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a033196-1d95-4f1b-88b1-542e6982262a None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.663769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a033196-1d95-4f1b-88b1-542e6982262a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.664073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a033196-1d95-4f1b-88b1-542e6982262a None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.665484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 706/1391] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:09:57.670842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5df51-b7a5-44b5-bc48-99e46ff0cc33 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.671179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5df51-b7a5-44b5-bc48-99e46ff0cc33 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.671452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5df51-b7a5-44b5-bc48-99e46ff0cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.686678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.691154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8ecb0-2c9e-42b1-8d5e-ec93c24ab154 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:57.708491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.741064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3de5df51-b7a5-44b5-bc48-99e46ff0cc33 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:57.742293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3de5df51-b7a5-44b5-bc48-99e46ff0cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.810127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:57.810652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:57.810934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:57.811232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:57.812903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:57.840676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 707/1392] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:57.909256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:57.910860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ddd68-63f9-41f4-a57e-53fa7402a137 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:57.929401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 686/1393] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:58.142425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.142907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.143145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.144597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 708/1394] 10.222.0.30 () {54 vars in 967 bytes} [Tue Aug 30 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:58.149794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8330b-3f37-44b3-aa47-9a870f9a516e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.150211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8330b-3f37-44b3-aa47-9a870f9a516e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.150352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8330b-3f37-44b3-aa47-9a870f9a516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.176902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:58.229878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3ec8330b-3f37-44b3-aa47-9a870f9a516e None None] MFA Rules not processed for user `25211db01b88403c8e4c9479ea9333c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:58.231260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ec8330b-3f37-44b3-aa47-9a870f9a516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.310882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 687/1395] 10.222.0.30 () {58 vars in 1064 bytes} [Tue Aug 30 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:58.319824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:58.321343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.419481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:58.427271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2494ef-c4bd-4080-8e09-5695775d7b11 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:58.501668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:09:58.502272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:58.502553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:58.502966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:58.507491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:58.624175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:09:58.625633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305944cd-2ccb-4d67-b6b9-a943006d038e service glance] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:09:58.643451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 709/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:09:59.381949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701f40-ad29-429e-b16d-c1169cdb4025 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:59.382409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701f40-ad29-429e-b16d-c1169cdb4025 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:59.382517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701f40-ad29-429e-b16d-c1169cdb4025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:59.449135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-41701f40-ad29-429e-b16d-c1169cdb4025 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:59.450507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-41701f40-ad29-429e-b16d-c1169cdb4025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:59.510787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:59.539093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 688/1397] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:09:59.585553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:59.586024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:59.586127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:59.587501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 710/1398] 10.222.0.30 () {54 vars in 943 bytes} [Tue Aug 30 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:59.594966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23dfd-e10c-4dd3-9ff7-86e4d4d1d361 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:59.595287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23dfd-e10c-4dd3-9ff7-86e4d4d1d361 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:59.595568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23dfd-e10c-4dd3-9ff7-86e4d4d1d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:59.672333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-45f23dfd-e10c-4dd3-9ff7-86e4d4d1d361 None None] MFA Rules not processed for user `72c7ab7c53954787bbd3970c139ceb56`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:59.673456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-45f23dfd-e10c-4dd3-9ff7-86e4d4d1d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:59.779525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 689/1399] 10.222.0.30 () {58 vars in 1040 bytes} [Tue Aug 30 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:09:59.788894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:09:59.790537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:09:59.814548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:59.883388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505c13-fe2e-47e7-b888-4e4e7e5c7478 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:59.883675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505c13-fe2e-47e7-b888-4e4e7e5c7478 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:59.883954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505c13-fe2e-47e7-b888-4e4e7e5c7478 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:59.885284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 690/1400] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:09:59.890584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:09:59.890871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:09:59.891172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:09:59.928131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814fe4-f3ea-423c-a5f1-142a9b171b63 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:09:59.936243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:59.958183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:09:59.959436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:00.053018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:00.053931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:00.055096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:00.055386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:00.057160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:00.068164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:00.079128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 691/1401] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:10:00.153898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:00.155708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eace8-5a6c-4e8e-b918-ea20514053e2 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:00.164539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 711/1402] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:09:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:00.366726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:00.367995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:00.497837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2968-0e8d-4a39-b261-98c1de9af3e8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:00.501738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:00.641895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:00.642651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:00.643027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:00.643376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:00.646455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:00.745034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:00.749125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d01e55-d4dd-48cf-8058-07605a87a46a service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:00.779347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 692/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:02.752253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:02.752877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:02.752877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:02.754318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 712/1404] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:02.759735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df676-ac49-4111-b329-ab42f5a1bb37 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:02.760214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df676-ac49-4111-b329-ab42f5a1bb37 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:02.760318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df676-ac49-4111-b329-ab42f5a1bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:02.772859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:02.833569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c74df676-ac49-4111-b329-ab42f5a1bb37 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:02.834954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c74df676-ac49-4111-b329-ab42f5a1bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:02.954805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 693/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:03.251036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:03.252582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:03.414058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203abb-6394-45d6-8f33-298b690a3f06 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:03.416942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:03.540185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:03.540905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:03.541202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:03.541502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:03.544377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:03.652214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:03.653976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1b5eb-348d-423d-aed5-686e96e00ef4 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:03.677165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 713/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:05.645150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.645709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.645709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.647179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 694/1407] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:05.652168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a2a-4991-440e-82c2-1643b26806d5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:05.652770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a2a-4991-440e-82c2-1643b26806d5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:05.652770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530a2a-4991-440e-82c2-1643b26806d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:05.662610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:05.722369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7f530a2a-4991-440e-82c2-1643b26806d5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:05.723708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7f530a2a-4991-440e-82c2-1643b26806d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:05.831666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 714/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:06.128254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:06.130038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:06.223622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:06.295226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0020375-b1c1-476a-bc26-dde675f719ef None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:06.464205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:06.466073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:06.466515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:06.466799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:06.469074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:06.559462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:06.614579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:06.619627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a7e8-743d-48a3-aa9d-2527abcf7dd6 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:06.644784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 695/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:15.830123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=62 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:16.642408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=23 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:22.462966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d11d-178f-4b4b-acd1-fde868a2dbd0 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:22.463593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d11d-178f-4b4b-acd1-fde868a2dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:22.463593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d11d-178f-4b4b-acd1-fde868a2dbd0 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:22.466021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 715/1410] 10.222.0.30 () {54 vars in 918 bytes} [Tue Aug 30 16:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:22.471016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd298-cc5e-4a73-98e1-607fe6f5831a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:22.471463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd298-cc5e-4a73-98e1-607fe6f5831a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:22.471625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd298-cc5e-4a73-98e1-607fe6f5831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:22.548170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-4f8bd298-cc5e-4a73-98e1-607fe6f5831a None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:22.549371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4f8bd298-cc5e-4a73-98e1-607fe6f5831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:22.660442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 696/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 30 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:10:22.675197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4949f-18ad-4cb5-85ce-d7f0e50dde0f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:22.675486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4949f-18ad-4cb5-85ce-d7f0e50dde0f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:22.675763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4949f-18ad-4cb5-85ce-d7f0e50dde0f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:22.677223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 716/1412] 10.222.0.30 () {54 vars in 918 bytes} [Tue Aug 30 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:22.681750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea925e0-4bfe-48f1-a135-0e8798db7e2b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:22.682037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea925e0-4bfe-48f1-a135-0e8798db7e2b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:22.682341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea925e0-4bfe-48f1-a135-0e8798db7e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:22.754486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:22.757693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3ea925e0-4bfe-48f1-a135-0e8798db7e2b None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:22.759541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ea925e0-4bfe-48f1-a135-0e8798db7e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:22.880449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 697/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 30 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:10:25.268559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:25.269119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:25.269119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:25.270502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:25.275670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1804c-0d0d-4682-af26-29e4624c714c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:25.276115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1804c-0d0d-4682-af26-29e4624c714c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:25.276837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1804c-0d0d-4682-af26-29e4624c714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:25.343182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f1f1804c-0d0d-4682-af26-29e4624c714c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:25.344311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f1f1804c-0d0d-4682-af26-29e4624c714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:25.398625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:25.441411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:25.735898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:25.737394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:25.883272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd882-964d-4a22-a222-28954ba0096b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:25.954757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:25.997769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:25.998292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:25.998566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:25.998833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:26.000453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:26.088566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:26.090717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4b778-fbea-4fbe-8a45-2fc57eaafb46 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:26.108673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 718/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:27.001618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:27.002147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:27.002147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:27.003549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:27.008504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377968-9aaa-4d87-8e46-4d4d1c7c7b1f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:27.008936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377968-9aaa-4d87-8e46-4d4d1c7c7b1f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:27.009059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377968-9aaa-4d87-8e46-4d4d1c7c7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:27.086095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5b377968-9aaa-4d87-8e46-4d4d1c7c7b1f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:27.087329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5b377968-9aaa-4d87-8e46-4d4d1c7c7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:27.114336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:27.182801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:27.333801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:27.335364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:27.481745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edd85e-ba46-40fd-866e-8cc0b3929cff None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:27.521308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:27.594715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:27.595259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:27.595538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:27.595808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:27.597405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:27.685641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:27.687278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd561104-5da0-4f02-b44e-6a446bf76851 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:27.705301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 700/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:28.591279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:28.591822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:28.591822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:28.593167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:28.598078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3450-8caf-4fd6-b839-e1dfaabb37a3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:28.598494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3450-8caf-4fd6-b839-e1dfaabb37a3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:28.598638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3450-8caf-4fd6-b839-e1dfaabb37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:28.654274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:28.676836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a56f3450-8caf-4fd6-b839-e1dfaabb37a3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:28.678029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a56f3450-8caf-4fd6-b839-e1dfaabb37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:28.772968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:28.935711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:28.937400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:29.080529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ca138-dbdd-4260-ab71-0bd2b383a86c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:29.092851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:29.192153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:29.192701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:29.192987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:29.193258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:29.194885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:29.286270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:29.287935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ca497-c56c-4236-94fa-26f964c6390e service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:29.305608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 721/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:30.164566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:30.165095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:30.165095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:30.166436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:30.171964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b387105-e853-4663-82e6-5a85b6025484 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:30.172366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b387105-e853-4663-82e6-5a85b6025484 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:30.172524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b387105-e853-4663-82e6-5a85b6025484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:30.192039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:30.249380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7b387105-e853-4663-82e6-5a85b6025484 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:30.250589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7b387105-e853-4663-82e6-5a85b6025484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:30.345329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:30.496601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:30.498164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:30.608775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:30.646765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfdced-0952-469e-8c1b-a380ce3b3d5a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:30.756373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:30.756936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:30.757219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:30.757495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:30.759136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:30.834998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:30.849903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:30.851576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ab0fc-0f82-4890-a0b2-fdf7571e48ce service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:30.870516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 703/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:31.758248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:31.759026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:31.759026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:31.760173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:31.766016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f5f1-46c2-43c6-9919-c220c8d6a7e6 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:31.766430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f5f1-46c2-43c6-9919-c220c8d6a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:31.766579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f5f1-46c2-43c6-9919-c220c8d6a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:31.843353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5f81f5f1-46c2-43c6-9919-c220c8d6a7e6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:31.844586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5f81f5f1-46c2-43c6-9919-c220c8d6a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:31.942128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:32.093035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:32.094464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:32.176708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:32.249098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1451e-7c89-4fd9-b63e-c454f1d80e47 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:32.371803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:32.372329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:32.372612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:32.372889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:32.374511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:32.423953 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:32.466072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:32.467723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf31ea-2f44-4514-aa5a-b8cddfdf7eb7 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:32.486060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 724/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:33.318225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:33.319094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:33.319094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:33.320159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:33.325850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbdb6-263c-4b28-87c9-55d757ad687f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:33.326308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbdb6-263c-4b28-87c9-55d757ad687f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:33.326412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbdb6-263c-4b28-87c9-55d757ad687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:33.403310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-75cdbdb6-263c-4b28-87c9-55d757ad687f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:33.404530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-75cdbdb6-263c-4b28-87c9-55d757ad687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:33.500670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:10:33.655210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:33.657284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:33.714270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:33.817754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff923d-575d-4dcb-9756-fbf54054d693 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:33.932067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:33.932627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:33.932965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:33.933246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:33.934840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:33.941735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:34.028290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:34.030006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c59ec1-cdf0-4813-9881-ab03a2e97c76 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:34.048662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 706/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:34.847065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:34.847479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:34.847600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:34.848974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:34.853939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de951-4d1e-4799-adcd-d404f50130ab None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:34.854455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de951-4d1e-4799-adcd-d404f50130ab None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:34.855328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de951-4d1e-4799-adcd-d404f50130ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:34.929203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-896de951-4d1e-4799-adcd-d404f50130ab None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:34.930308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-896de951-4d1e-4799-adcd-d404f50130ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:34.998597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:35.029338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:35.181388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:35.182908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:35.201271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:35.329581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9092d-8ef1-4f2c-84b2-7c9fce4fed90 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:35.416942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:35.447734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:35.448959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:35.449556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:35.449886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:35.451855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:35.543841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:35.545431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebd489-c640-43d8-9243-de2bd4af1ac7 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:35.563663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 727/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:10:36.462831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:36.463331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:36.463440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:36.465269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:36.470165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7415a0-d730-436f-9222-9d8dbc7a279a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:36.470585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7415a0-d730-436f-9222-9d8dbc7a279a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:36.470770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7415a0-d730-436f-9222-9d8dbc7a279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:36.546886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6d7415a0-d730-436f-9222-9d8dbc7a279a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:36.548107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6d7415a0-d730-436f-9222-9d8dbc7a279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:36.588625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:36.643999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:36.791580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:36.793540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:36.940154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabfb1e-fef3-4879-bd2e-259a5f806258 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:36.994314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:37.052771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:37.053299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:37.053576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:37.053845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:37.055460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:37.143853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:37.145474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbe756-cb2e-4efe-8c3b-dff6359fb990 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:37.162959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 709/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:37.969160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:37.969727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:37.969727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:37.971064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:37.975830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9819-e74c-415d-a8db-add8b4a2638d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:37.976231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9819-e74c-415d-a8db-add8b4a2638d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:37.976367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9819-e74c-415d-a8db-add8b4a2638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:38.051829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-960d9819-e74c-415d-a8db-add8b4a2638d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:38.053029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-960d9819-e74c-415d-a8db-add8b4a2638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:38.055050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:38.149850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:38.300653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:38.302182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:38.446773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe70b7-7d90-4070-b7fd-01d6f0fd2477 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:38.473380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:38.559625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:38.560236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:38.560510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:38.560777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:38.562365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:38.650491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:38.652152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3435e5-959e-4328-9e79-68355ddb1386 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:38.669971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 730/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:40.477355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:40.477930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:40.477930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:40.479796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:40.485397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d495-d871-4592-82e5-19bd80a82983 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:40.485855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d495-d871-4592-82e5-19bd80a82983 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:40.485953 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d495-d871-4592-82e5-19bd80a82983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:40.526398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:40.552239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-0791d495-d871-4592-82e5-19bd80a82983 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:40.553460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0791d495-d871-4592-82e5-19bd80a82983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:40.649081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:40.930812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:40.932497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:41.038039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713f599-1bc4-4370-b269-0bdbecb3fbcc None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:41.068773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:41.110286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:41.110809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:41.111111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:41.111381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:41.112964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:41.219928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:41.221368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e14f6-9874-4297-b81d-2f7e971344ff service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:41.239997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 712/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:43.292511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:43.293113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:43.293113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:43.294384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:43.299887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33522065-5aff-4547-b49d-be4436a00711 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:43.300296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33522065-5aff-4547-b49d-be4436a00711 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:43.300485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33522065-5aff-4547-b49d-be4436a00711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:43.367936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-33522065-5aff-4547-b49d-be4436a00711 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:43.369154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-33522065-5aff-4547-b49d-be4436a00711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:43.382484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:43.466530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:43.748998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:43.750583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:43.853793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107a055-743d-4443-82e1-addd9ce27b6f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:43.867120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:43.927887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:43.928406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:43.928689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:43.928964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:43.930564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:44.038124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:44.039628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea472a-2a8d-445b-a592-564099b1467b service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:44.059102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 733/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:46.277790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:46.278328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:46.278328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:46.279704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:46.284781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b9383-daf4-4cf0-ad51-c6279a971aba None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:46.285185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b9383-daf4-4cf0-ad51-c6279a971aba None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:46.285353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b9383-daf4-4cf0-ad51-c6279a971aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:46.333668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:46.352912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5f6b9383-daf4-4cf0-ad51-c6279a971aba None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:46.354139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5f6b9383-daf4-4cf0-ad51-c6279a971aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:46.451809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:46.734092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:46.735679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:46.837035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f812ff4-7616-4633-9c7c-c421b4ec36da None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:46.877658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:46.911009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:46.911558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:46.911838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:46.912112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:46.913709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:47.021101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:47.022528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34df93-fe01-4a74-9165-0aa6d475b01e service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:47.040203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 715/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:49.129379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:49.129955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:49.129955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:49.131373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:49.137417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4549-bdb3-4632-9014-e52a8ea62b88 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:49.137863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4549-bdb3-4632-9014-e52a8ea62b88 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:49.137971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4549-bdb3-4632-9014-e52a8ea62b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:49.204388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-62ce4549-bdb3-4632-9014-e52a8ea62b88 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:49.205601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-62ce4549-bdb3-4632-9014-e52a8ea62b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:49.226443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:49.305097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:49.588242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:49.590514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:49.693683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56be4b4-3a42-48d9-988f-eca6ec43697d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:49.713640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:49.767298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:49.767900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:49.768182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:49.768462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:49.770060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:49.878332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:49.879802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e89680-1a25-40bc-881d-e16c2725f0ff service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:49.897995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 736/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:51.853870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:51.854914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:51.854914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:51.856297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:51.861579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6fc3-e791-4be2-a5f7-6ca12fd6d31d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:51.861981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6fc3-e791-4be2-a5f7-6ca12fd6d31d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:51.862137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6fc3-e791-4be2-a5f7-6ca12fd6d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:51.926097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:51.929176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-59ed6fc3-e791-4be2-a5f7-6ca12fd6d31d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:51.931014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-59ed6fc3-e791-4be2-a5f7-6ca12fd6d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:52.025482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:52.320411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:52.321947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:52.423771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4e8d-041a-4cbc-9a75-30686b6c695e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:52.470932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:52.496735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:52.497345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:52.497630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:52.497937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:52.499640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:52.608434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:52.610088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60088e4-147d-40c2-b8d6-3c2c41646427 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:52.628774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 718/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:54.609958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:54.610498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:54.610498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:54.611874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:54.617462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90217f-337f-49ce-b7a6-0bee057e6694 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:54.617862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90217f-337f-49ce-b7a6-0bee057e6694 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:54.618016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90217f-337f-49ce-b7a6-0bee057e6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:54.685565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6e90217f-337f-49ce-b7a6-0bee057e6694 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:54.686777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6e90217f-337f-49ce-b7a6-0bee057e6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:54.717728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:54.788796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:55.072180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:55.074289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:55.179457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa26a4-bad7-4a1f-8dea-85c169eee782 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:55.208795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:55.255027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:55.255633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:55.255918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:55.256193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:55.257811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:55.366505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:55.368008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010337c-4d0e-4350-aa7d-f0cfe17abc1f service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:55.386217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 739/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:10:57.334631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:57.335239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:57.335239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:57.336534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:10:57.342588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a620-f9c5-489e-8915-8093dc9bea92 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:57.343059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a620-f9c5-489e-8915-8093dc9bea92 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:57.343158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a620-f9c5-489e-8915-8093dc9bea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:57.408629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9b73a620-f9c5-489e-8915-8093dc9bea92 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:10:57.409838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9b73a620-f9c5-489e-8915-8093dc9bea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:57.418383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:57.505582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:10:57.793275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:10:57.794843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:57.898356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad9dc-6e1c-4b3a-836a-e8385a85887c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:10:57.953617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:57.972296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:10:57.972910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:10:57.973193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:10:57.973472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:10:57.975133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:10:58.084687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:10:58.086040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cdbfe-2002-48da-ab0a-639a5ae57155 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:10:58.103714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 721/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:00.047903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:00.048444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:00.048444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:00.049792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:00.054897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033bc8d-7f07-40c7-b9dd-b1ec1f8b0d04 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:00.055335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033bc8d-7f07-40c7-b9dd-b1ec1f8b0d04 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:00.055499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033bc8d-7f07-40c7-b9dd-b1ec1f8b0d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:00.122630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d033bc8d-7f07-40c7-b9dd-b1ec1f8b0d04 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:00.123774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d033bc8d-7f07-40c7-b9dd-b1ec1f8b0d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:00.279921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:00.337152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:00.617167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:00.618746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:00.721399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0051-7116-4f13-aebb-4e2fb458c347 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:00.757791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:00.793532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:00.794122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:00.794399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:00.794668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:00.796315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:00.905041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:00.906416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ed1d-76e5-488f-91ec-b83e9d5a568e service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:00.924378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 742/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:02.949175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:02.949681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:02.949776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:02.951052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:02.956237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba09a2-85af-4a95-b82d-15225c47d376 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:02.956675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba09a2-85af-4a95-b82d-15225c47d376 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:02.956775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba09a2-85af-4a95-b82d-15225c47d376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:03.022557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-0eba09a2-85af-4a95-b82d-15225c47d376 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:03.023804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0eba09a2-85af-4a95-b82d-15225c47d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:03.042257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:03.119890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:03.410988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:03.412542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:03.514708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738dedd-dd22-49b3-967d-7c1fd70811c1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:03.580221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:03.587363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:03.587964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:03.588242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:03.588513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:03.590591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:03.699640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:03.701077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff14298-2bb5-4219-95c2-dd3360671f0f service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:03.718665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 724/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:05.611809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:05.612416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:05.612416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:05.613711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:11:05.619362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d755-fd4b-4409-8be6-c18a57a46e9b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:05.620317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d755-fd4b-4409-8be6-c18a57a46e9b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:05.620428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d755-fd4b-4409-8be6-c18a57a46e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:05.685983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6693d755-fd4b-4409-8be6-c18a57a46e9b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:05.687213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6693d755-fd4b-4409-8be6-c18a57a46e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:05.734709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:05.782551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:06.073955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:06.075556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:06.178044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f11b-f7fa-4a04-b396-8eef7365de54 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:06.227839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:06.255127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:06.255729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:06.256011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:06.256289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:06.257891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:06.367036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:06.368403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34983d81-96c0-42ab-a8ef-dcdad9df2759 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:06.385975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 745/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:15.780840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=22 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:16.383641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=66 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:26.556605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb049-380f-4e2b-b5bd-a9c5be045fa3 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:26.557668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb049-380f-4e2b-b5bd-a9c5be045fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:26.557800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb049-380f-4e2b-b5bd-a9c5be045fa3 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:26.559034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 726/1471] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:26.564138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165417b-e08b-4581-acca-0ae6e03af04f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:26.564572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165417b-e08b-4581-acca-0ae6e03af04f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:26.564702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165417b-e08b-4581-acca-0ae6e03af04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:26.631600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b165417b-e08b-4581-acca-0ae6e03af04f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:26.632806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b165417b-e08b-4581-acca-0ae6e03af04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:26.727255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 746/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:27.023173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:27.023460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:27.023736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:27.025038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 727/1473] 10.222.0.30 () {54 vars in 967 bytes} [Tue Aug 30 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:27.029776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d2f-300e-41e3-ba93-4aa258beb81f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:27.030064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d2f-300e-41e3-ba93-4aa258beb81f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:27.030342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d2f-300e-41e3-ba93-4aa258beb81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:27.105349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5eea3d2f-300e-41e3-ba93-4aa258beb81f None None] MFA Rules not processed for user `25211db01b88403c8e4c9479ea9333c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:27.106490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5eea3d2f-300e-41e3-ba93-4aa258beb81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:27.127279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:27.182729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 747/1474] 10.222.0.30 () {58 vars in 1064 bytes} [Tue Aug 30 16:11:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:27.190167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:27.191717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:27.295173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df5cb2-8958-4a10-a414-b18bd58a2d99 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:27.365828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:27.366359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:27.366642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:27.367174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:27.368778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:27.421322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:27.479561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:27.481017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0f8bd-a1a2-45d7-b0fe-e7be4c1b1a40 service glance] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:27.499775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 728/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:29.486912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:29.487517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:29.487517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:29.488845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 748/1476] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:29.494286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60179-8d7f-413a-bdf6-746570a9d1aa None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:29.495220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60179-8d7f-413a-bdf6-746570a9d1aa None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:29.495417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60179-8d7f-413a-bdf6-746570a9d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:29.560358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-29c60179-8d7f-413a-bdf6-746570a9d1aa None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:29.561556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-29c60179-8d7f-413a-bdf6-746570a9d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:29.657869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 729/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:29.932901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:29.934444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:30.059005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a258b-79a0-4d9f-bf08-fe0b832b5dda None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:30.107132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:30.153875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:30.154479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:30.154765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:30.155067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:30.155712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:30.157474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:11:30.157474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:11:30.157474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:11:30.158618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1045a5-cda4-439b-873c-01eea565f6e8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:30.178635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 749/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Aug 30 16:11:29 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:11:32.090922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:32.091460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:32.091460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:32.092730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 730/1479] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:32.097864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc510a7-8232-442d-b149-4932f8f9c40f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:32.098305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc510a7-8232-442d-b149-4932f8f9c40f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:32.098409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc510a7-8232-442d-b149-4932f8f9c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:32.163352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1dc510a7-8232-442d-b149-4932f8f9c40f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:32.164547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1dc510a7-8232-442d-b149-4932f8f9c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:32.259664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 750/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:32.553262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:32.554920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:32.564939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:32.698071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989737a3-eb23-447f-a499-c9d35466a8de None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:32.777465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:32.811163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:32.811699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:32.811978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:32.812256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:32.813846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:32.908137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:32.909742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fd860-f644-4248-9b03-a58329ea1654 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:32.927492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 731/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:11:35.011052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:35.011742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:35.011742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:35.012980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 751/1482] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:35.018125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd1ca-ba74-4237-952f-3923b226d939 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:35.018594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd1ca-ba74-4237-952f-3923b226d939 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:35.018698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd1ca-ba74-4237-952f-3923b226d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:35.085412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bcddd1ca-ba74-4237-952f-3923b226d939 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:35.086624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bcddd1ca-ba74-4237-952f-3923b226d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:35.133705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:35.185010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 732/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:35.470246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:35.471833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:35.495898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:35.577950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e634b1e-a29a-4009-a8da-7271e9e4f91e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:35.650101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:35.650701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:35.651606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:35.651886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:35.653478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:35.726097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:35.761910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:35.763394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8b22-f355-48ff-bd5a-ce1afde7549f service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:35.783608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 752/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:37.741371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:37.741925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:37.741925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:37.743559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 733/1485] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:11:37.749425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974efa-564a-4ad2-ab14-65627a383fe6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:37.749901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974efa-564a-4ad2-ab14-65627a383fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:37.750008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974efa-564a-4ad2-ab14-65627a383fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:37.932732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5c974efa-564a-4ad2-ab14-65627a383fe6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:37.933928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5c974efa-564a-4ad2-ab14-65627a383fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:38.028827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 753/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:38.321951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:38.324105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:38.427100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a4b3-9b79-407e-ae0b-1a26da44484f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:38.498621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:38.500520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:38.501126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:38.501590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:38.502067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:38.503869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:38.609790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:38.611196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297136c-f347-44ad-ba6e-a997da50e421 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:38.629576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 734/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:40.744405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:40.745157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:40.745157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:40.746471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 754/1488] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:40.751752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6740be-6646-455a-b1ff-369b2131ada8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:40.752215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6740be-6646-455a-b1ff-369b2131ada8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:40.752315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6740be-6646-455a-b1ff-369b2131ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:40.817624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9a6740be-6646-455a-b1ff-369b2131ada8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:40.818834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9a6740be-6646-455a-b1ff-369b2131ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:40.872898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:40.917419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 735/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:41.204968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:41.206515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:41.242789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:41.311599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97aa7a-3396-46db-9183-d72c01fc6b40 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:41.384193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:41.384793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:41.385195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:41.386296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:41.387842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:41.464920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:41.495462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:41.497035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1da365-e02d-4ac9-aa55-7cf1f827dc82 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:41.515018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 755/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:43.621103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:43.621666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:43.621666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:43.622958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 736/1491] 10.222.0.30 () {54 vars in 927 bytes} [Tue Aug 30 16:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:11:43.628263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6eca4-d772-4a44-9dea-70b76fc2d30c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:43.628727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6eca4-d772-4a44-9dea-70b76fc2d30c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:43.628890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6eca4-d772-4a44-9dea-70b76fc2d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:43.695678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-47e6eca4-d772-4a44-9dea-70b76fc2d30c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:11:43.696874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-47e6eca4-d772-4a44-9dea-70b76fc2d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:43.792853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 756/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Aug 30 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:11:44.082530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:11:44.084104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:44.186801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d74e-a1c0-426e-8a50-548a64567ae9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:11:44.261835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:11:44.262444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:11:44.262725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:11:44.263021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:11:44.264626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:11:44.273672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:44.372798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:11:44.374151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523d01-d25e-4053-89b8-01c705b3e7a8 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:11:44.392317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 737/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:53.790531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=82 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:54.390050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=50 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:57.178131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:57.178682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:57.178682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:57.253294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:12:57.254502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:57.350874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 757/1494] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:12:57.359752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:57.360252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:57.360367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:57.434159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:12:57.435320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:57.530260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 738/1495] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:12:57.534812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:57.536048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:57.548002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ede8-54bf-4eb8-a8d2-2e55776dfad6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:57.609006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:57.643804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:57.644403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:57.644689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:57.644960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:57.645595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:12:57.645896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:57.646905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:57.646905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:12:57.646905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:12:57.647825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:57.659179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 758/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:12:57.668157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:57.677123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5290040-311e-49d9-929b-c28ce80c09d1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:57.736168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:57.770123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:57.770721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:57.771019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:57.771297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:57.771933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:57.773649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:57.773649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:12:57.773649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:12:57.774842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:57.830738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 739/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:12:57 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:12:57.835058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:57.836572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:57.871909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62ac2-f52a-41a7-9c28-df8ef757f365 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:57.964612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:57.965212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:57.965490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:57.965762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:57.966397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:57.967435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:57.967435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:12:57.967435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:12:57.968648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:58.010263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 759/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:12:57 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:12:58.014468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:58.016046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.078782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660711c8-0f64-4751-9dec-57c62c165ced admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:58.161829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:58.173959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:58.174563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.174843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.175156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.175796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:58.176834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:58.176834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:12:58.176834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:12:58.177717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:58.189744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 740/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:12:58.194037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:58.195595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.206808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2cbd6-1646-41ef-b20d-e4b634de6598 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:58.232167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:58.303060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:58.303584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.303863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.304133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.304766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:58.305815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:58.305815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:12:58.305815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:12:58.306771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1509a09-5c37-4ecd-a9c8-6b27e0035837 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:58.319085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 760/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:12:58.324078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:58.325591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.358855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d32bb-e296-4fe2-944a-a8b95921fa0e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:58.451873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:58.452524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.452783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.453049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] PATH_INFO: `/v3/projects/05fe175920fe401ca4e82517d57797bc/users/520d218cdc904d0bb2f870527004e97c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.474963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fe175920fe401ca4e82517d57797bc, user_id=520d218cdc904d0bb2f870527004e97c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:58.476006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:58.476006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:12:58.476006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:12:58.478241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36026cde-5423-42a0-9ef6-9721c58d17c7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:58.502040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 741/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:12:58 2022] PUT /identity/v3/projects/05fe175920fe401ca4e82517d57797bc/users/520d218cdc904d0bb2f870527004e97c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:12:58.514511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b565b6-5ead-480c-b7d2-8359f17ca154 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.514802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b565b6-5ead-480c-b7d2-8359f17ca154 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.515110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b565b6-5ead-480c-b7d2-8359f17ca154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.572662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-08b565b6-5ead-480c-b7d2-8359f17ca154 None None] MFA Rules not processed for user `520d218cdc904d0bb2f870527004e97c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:12:58.573774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-08b565b6-5ead-480c-b7d2-8359f17ca154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.651065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 761/1502] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:12:58.664098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.664387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.664663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.666043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 742/1503] 10.222.0.30 () {54 vars in 964 bytes} [Tue Aug 30 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:12:58.670682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce254c7-3d0f-4dd1-8d79-142a7e927013 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:58.670972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce254c7-3d0f-4dd1-8d79-142a7e927013 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:58.671281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce254c7-3d0f-4dd1-8d79-142a7e927013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:58.702546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:58.747362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1ce254c7-3d0f-4dd1-8d79-142a7e927013 None None] MFA Rules not processed for user `dc6e7b66794e4416ba15562e47e9888f`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:12:58.748548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1ce254c7-3d0f-4dd1-8d79-142a7e927013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.821127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 762/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Aug 30 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:12:58.831242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:58.832695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:58.882064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:58.934918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb337fc1-78f3-426e-bb82-4973e4713e59 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:59.006324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:59.006926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:59.007231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:59.007501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:59.009648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:59.106342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:59.107705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:59.111107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:59.126500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 743/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:12:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:12:59.172168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7d47-5b2a-48a1-8d5a-198d9131e5fd None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:59.172454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7d47-5b2a-48a1-8d5a-198d9131e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:59.172754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7d47-5b2a-48a1-8d5a-198d9131e5fd None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:59.174024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 763/1506] 10.222.0.30 () {52 vars in 830 bytes} [Tue Aug 30 16:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:12:59.177440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:59.178632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:59.280525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691e4-6960-46d6-aad2-53a13dccf10b service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:59.373681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:59.374239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:59.374516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:59.374789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] PATH_INFO: `/v3/users/520d218cdc904d0bb2f870527004e97c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:59.386885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=520d218cdc904d0bb2f870527004e97c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:59.387929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:12:59.387929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:12:59.387929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:12:59.389142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:59.398485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:59.453452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520d218cdc904d0bb2f870527004e97c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:12:59.476158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520d218cdc904d0bb2f870527004e97c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:12:59.490392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520d218cdc904d0bb2f870527004e97c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:12:59.499154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520d218cdc904d0bb2f870527004e97c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:12:59.499725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520d218cdc904d0bb2f870527004e97c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:12:59.505381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 744/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:12:59 2022] DELETE /identity/v3/users/520d218cdc904d0bb2f870527004e97c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:12:59.510340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:59.510833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:59.510939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:59.566965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:12:59.568229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:59.643021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:59.656846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 764/1508] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:12:59.667717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:12:59.668944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:59.771040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c818-9769-4141-bcf2-eb2c814bdadf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:12:59.826602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:59.848353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:12:59.848975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:12:59.849258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:12:59.849530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:12:59.851166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:12:59.958349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:12:59.959816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6023-28c4-41d5-a1bc-bca535b6ed00 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:12:59.978378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 745/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:13:00.333599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:13:00.334866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:13:00.346311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809ead7-25ae-4f94-8513-c34c316904ce None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:13:00.449148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:13:00.449764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:13:00.450039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:13:00.450301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] PATH_INFO: `/v3/projects/05fe175920fe401ca4e82517d57797bc` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:13:00.459905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fe175920fe401ca4e82517d57797bc)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:13:00.460977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:13:00.460977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:13:00.460977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:13:00.462157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:13:00.518831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fe175920fe401ca4e82517d57797bc', 'request_id': 'req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:13:00.528711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fe175920fe401ca4e82517d57797bc', 'request_id': 'req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:13:00.542450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fe175920fe401ca4e82517d57797bc', 'request_id': 'req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:13:00.566025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] The token cache is being invalidate because project 05fe175920fe401ca4e82517d57797bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:13:00.566311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:13:00.566733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8c0ce1b5-889b-4e89-8935-bdd8ec05074e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:13:00.568108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 765/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:13:00 2022] DELETE /identity/v3/projects/05fe175920fe401ca4e82517d57797bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:13:09.976149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=62 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:10.564069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:31.842563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:31.843020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:31.843124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:31.844455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:31.849322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd72f4-d7b1-42ab-ac82-8780e7fc2bdd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:31.849764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd72f4-d7b1-42ab-ac82-8780e7fc2bdd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:31.849941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd72f4-d7b1-42ab-ac82-8780e7fc2bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:31.934468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-67cd72f4-d7b1-42ab-ac82-8780e7fc2bdd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:31.935733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-67cd72f4-d7b1-42ab-ac82-8780e7fc2bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:32.038869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:32.193316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:32.196133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:32.316855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177e533-59c4-4711-8a4b-e63a68d4edac None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:32.323035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:32.323641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:32.323923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:32.324195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:32.332110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:32.333706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7315b-c527-4494-9e8c-527abbe2b77c service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:32.343509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 747/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:33.176850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808feba0-5fdd-4e00-9128-e824d750bb7f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:33.177386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808feba0-5fdd-4e00-9128-e824d750bb7f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:33.177386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808feba0-5fdd-4e00-9128-e824d750bb7f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:33.178656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:33.183634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60346-f67d-4bb2-badb-13cbc7b1adb4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:33.184038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60346-f67d-4bb2-badb-13cbc7b1adb4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:33.184197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60346-f67d-4bb2-badb-13cbc7b1adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:33.203498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a9d60346-f67d-4bb2-badb-13cbc7b1adb4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:33.204702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a9d60346-f67d-4bb2-badb-13cbc7b1adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:33.213623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:33.364706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808feba0-5fdd-4e00-9128-e824d750bb7f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:33.379313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808feba0-5fdd-4e00-9128-e824d750bb7f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:33.384970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:33.385553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:33.385831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:33.386100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:33.393940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:33.395578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d3a4-8866-4ace-b3e3-987d7a7d9b23 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:33.405577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 768/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:34.000187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde9e21-6ca3-498f-ad1c-8ab34e912e71 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:34.000473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde9e21-6ca3-498f-ad1c-8ab34e912e71 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:34.000750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde9e21-6ca3-498f-ad1c-8ab34e912e71 None None] PATH_INFO: `/v3` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:34.002044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 749/1517] 10.222.0.17 () {54 vars in 925 bytes} [Tue Aug 30 16:14:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:14:34.009650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2215e-5cbf-4386-95ef-921c8512649c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:34.009939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2215e-5cbf-4386-95ef-921c8512649c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:34.010219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2215e-5cbf-4386-95ef-921c8512649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:34.069027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b4e2215e-5cbf-4386-95ef-921c8512649c None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:34.070834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b4e2215e-5cbf-4386-95ef-921c8512649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:34.087768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:34.142687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 769/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 30 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:37.899314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2e5c-6cec-40cd-a138-1e9c6cae6ca0 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:37.899813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2e5c-6cec-40cd-a138-1e9c6cae6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:37.899813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b2e5c-6cec-40cd-a138-1e9c6cae6ca0 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:37.901134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 750/1519] 10.222.0.30 () {54 vars in 961 bytes} [Tue Aug 30 16:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:14:37.906200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16261-e5de-420d-9a52-41cc76e68ef6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:37.906624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16261-e5de-420d-9a52-41cc76e68ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:37.906753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16261-e5de-420d-9a52-41cc76e68ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:37.926402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ebf16261-e5de-420d-9a52-41cc76e68ef6 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:37.927686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ebf16261-e5de-420d-9a52-41cc76e68ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:37.936519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 770/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Aug 30 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:37.943699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b2e5c-6cec-40cd-a138-1e9c6cae6ca0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:37.957088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b2e5c-6cec-40cd-a138-1e9c6cae6ca0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:37.962739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:37.963368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:37.963649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:37.963918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:37.972036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:37.973601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6058cf9-ba5d-4e59-93e7-ef2679077a15 service placement] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:37.983682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 751/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:14:44.636116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7830a3-f21c-466e-8b59-5c516e140cfd None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:44.636717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7830a3-f21c-466e-8b59-5c516e140cfd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:44.636717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7830a3-f21c-466e-8b59-5c516e140cfd None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:44.638046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:44.642933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43434bf-66fe-4f65-98e3-6e79bfe6577b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:44.643393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43434bf-66fe-4f65-98e3-6e79bfe6577b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:44.643512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43434bf-66fe-4f65-98e3-6e79bfe6577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:44.663173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d43434bf-66fe-4f65-98e3-6e79bfe6577b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:44.664939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d43434bf-66fe-4f65-98e3-6e79bfe6577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:44.672829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:44.827120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7830a3-f21c-466e-8b59-5c516e140cfd None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:44.844615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7830a3-f21c-466e-8b59-5c516e140cfd None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:44.850180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:44.850787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:44.851100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:44.851514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:44.860064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:44.861660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545a567-6585-40cb-b4e6-491a5f6a5100 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:44.871876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 772/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:14:45.686652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f33d1-eb27-4edb-afc9-fa9b86570450 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:45.687262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f33d1-eb27-4edb-afc9-fa9b86570450 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:45.687262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f33d1-eb27-4edb-afc9-fa9b86570450 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:45.688584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 16:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:45.693247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddae21-a40e-44e0-8d5a-90444ba17460 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:45.693701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddae21-a40e-44e0-8d5a-90444ba17460 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:45.693808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddae21-a40e-44e0-8d5a-90444ba17460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:45.713151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-14ddae21-a40e-44e0-8d5a-90444ba17460 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:45.714357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-14ddae21-a40e-44e0-8d5a-90444ba17460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:45.722435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 16:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:45.871943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f33d1-eb27-4edb-afc9-fa9b86570450 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:45.886382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f33d1-eb27-4edb-afc9-fa9b86570450 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:45.891839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:45.892433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:45.892716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:45.892991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:45.901585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:45.903205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba76639-ccea-40bc-af2b-937e0a963a10 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:45.912454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 754/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:49.782616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:49.783194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:49.783194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:49.784546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:49.789710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef70b2-14bd-44f2-baf2-017f4724eb94 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:49.790172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef70b2-14bd-44f2-baf2-017f4724eb94 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:49.790269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef70b2-14bd-44f2-baf2-017f4724eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:49.809692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ecef70b2-14bd-44f2-baf2-017f4724eb94 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:49.810883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ecef70b2-14bd-44f2-baf2-017f4724eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:49.818582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:50.119704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:50.121689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:50.204928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f38ac-ee05-4794-a6e1-8324820314f5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:50.210349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:50.210967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:50.211283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:50.211558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:50.223178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:50.224636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64fb77-3b2d-4481-9d50-a334ab0ffbc4 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:50.235302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 775/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:52.286960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68191a9-08f7-42da-9088-7bc6d2237904 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:52.287536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68191a9-08f7-42da-9088-7bc6d2237904 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:52.287536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68191a9-08f7-42da-9088-7bc6d2237904 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:52.288867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:52.294694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8239c00-f40f-43c7-975f-0a4e5458ec85 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:52.295151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8239c00-f40f-43c7-975f-0a4e5458ec85 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:52.295342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8239c00-f40f-43c7-975f-0a4e5458ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:52.315309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e8239c00-f40f-43c7-975f-0a4e5458ec85 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:52.316507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e8239c00-f40f-43c7-975f-0a4e5458ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:52.324568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:52.614470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68191a9-08f7-42da-9088-7bc6d2237904 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:52.625860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68191a9-08f7-42da-9088-7bc6d2237904 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:52.629433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:52.630024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:52.630302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:52.630571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:52.639668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:52.641724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82e60-2890-413c-bf75-246ad571fb96 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:52.657282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 757/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:55.953241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:55.953843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:55.953843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:55.955132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:55.960153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a41e-4ef8-449c-8d50-3cc2443d76f1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:55.960549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a41e-4ef8-449c-8d50-3cc2443d76f1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:55.960700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a41e-4ef8-449c-8d50-3cc2443d76f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:55.980385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9194a41e-4ef8-449c-8d50-3cc2443d76f1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:55.981572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9194a41e-4ef8-449c-8d50-3cc2443d76f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:55.989246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:56.538052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:56.539832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:56.604446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:56.617622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224e847-9a72-4270-86b2-ae996fcccd20 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:56.622052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:56.622656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:56.622935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:56.623245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:56.631996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:56.634045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54131a-2eba-49a8-8f46-aeaf8869b6e8 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:56.643352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 778/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:14:58.571341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:58.571925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:58.571925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:58.573240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 16:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:14:58.578322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46ab01-75be-4508-a9fd-62428cc5cdbd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:58.578758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46ab01-75be-4508-a9fd-62428cc5cdbd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:58.578867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46ab01-75be-4508-a9fd-62428cc5cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:58.598597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fd46ab01-75be-4508-a9fd-62428cc5cdbd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:14:58.599825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fd46ab01-75be-4508-a9fd-62428cc5cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:58.608269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:14:59.160342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:14:59.162060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:14:59.175342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98787a0b-c854-4c67-a69b-1a5d7e94b321 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:14:59.178910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:14:59.179532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:14:59.179814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:14:59.180091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:14:59.189013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:14:59.190433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d210f9d-8d65-4fa4-992d-13171e661c8e service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:14:59.200224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 760/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:15:08.593723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=11 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:09.195541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:26.216954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.218116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.218634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.248323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.249934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.258655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 780/1540] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:26.267562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.268672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.269074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.300133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.301535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.319717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 761/1541] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:26.324100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.335111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114cde-1046-4255-b0dd-dc3e71fdcfc5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.347703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.348341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.348624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.348902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.349561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:26.350228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.354172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.369050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 781/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:16:26.378074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.392634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb123e01-9c9e-483a-ba00-893365a20687 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.397793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.398423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.398704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.398998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.399664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.401606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54281d-b6c4-4813-84bd-0533a1a993a4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.458327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 762/1543] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:16:26.462169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.475719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9096-75d6-43d2-b321-8d9ebbd91951 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.479970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3592-d077-474b-b700-4bc2ded69fce None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.480229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3592-d077-474b-b700-4bc2ded69fce None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.480511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3592-d077-474b-b700-4bc2ded69fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.505939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6e0d3592-d077-474b-b700-4bc2ded69fce None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.507186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6e0d3592-d077-474b-b700-4bc2ded69fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.576311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.576991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.577276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.577554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.578220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.580628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027de86-93d0-4d78-aa21-1937b784caa7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.593314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 763/1544] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:16:26.595930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.596264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.596488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.621796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 782/1545] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:26.626103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf9b4-8347-4db3-aee7-ce6a516249b9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.626397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf9b4-8347-4db3-aee7-ce6a516249b9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.626680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cf9b4-8347-4db3-aee7-ce6a516249b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.638467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.639912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.660649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 764/1546] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:26.661525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.676345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-173cf9b4-8347-4db3-aee7-ce6a516249b9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.677631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-173cf9b4-8347-4db3-aee7-ce6a516249b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.685955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f4012-0595-442c-a810-31430e3bde58 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.700426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.701084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.701983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.701983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.702190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 783/1547] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:26.702620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.703061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.703349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.703624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.705087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.723792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 765/1548] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:26.724780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.748409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.749580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.750142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ca028-6369-4fd7-b434-6ecf78bec50d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.764365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.765052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.765340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.765618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.766283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:26.766589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.767651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:26.767651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:16:26.767651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:16:26.768553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.776812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 784/1549] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:26.778030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.792743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df182c5-43b3-405f-9a6f-708ea609f20a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.796977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 766/1550] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:26.797903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.809559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.810191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.810467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.810747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.811427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.813058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.815443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e92d4-6b1c-4499-9af2-e95ad578f006 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.835130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 785/1551] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:26.835994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.842039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.842152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.842430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.842711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.843405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:26.843713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.845353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.854450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787f2d2-465e-47cc-a82e-ac20a3c504e2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.869149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 767/1552] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:26.870128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:26.871870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.872773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.873062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.873340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.873980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.879089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:26.879089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:16:26.879089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:16:26.880371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd52c60-65cc-4653-8e25-052fc4bf9e1d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.881397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825720-28da-46d7-ac11-de30db567475 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:26.886751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:26.888016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.888357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.888638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] PATH_INFO: `/v3/projects/857e4026c9214f0dad1fca94fe68a073/users/ea2ee7a078a140adad2559bc9add3486/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.905827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857e4026c9214f0dad1fca94fe68a073, user_id=ea2ee7a078a140adad2559bc9add3486, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:26.908637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807ac1-021b-4f99-bc1e-0b82ab9c87b0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:26.925462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 768/1553] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:26 2022] PUT /identity/v3/projects/857e4026c9214f0dad1fca94fe68a073/users/ea2ee7a078a140adad2559bc9add3486/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:26.926725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.927043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.927327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.935323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 786/1554] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:26.936686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b746-fa15-4181-b58d-5d85e7318c4f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:26.936978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b746-fa15-4181-b58d-5d85e7318c4f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:26.937255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b746-fa15-4181-b58d-5d85e7318c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:26.965694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.966449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ab47b746-fa15-4181-b58d-5d85e7318c4f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:26.967049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:26.967901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ab47b746-fa15-4181-b58d-5d85e7318c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.017480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.030927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 769/1555] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.031773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.037876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 787/1556] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.039205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb854-43a3-4969-a54f-6501696f320e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.039497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb854-43a3-4969-a54f-6501696f320e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.039775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb854-43a3-4969-a54f-6501696f320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.041877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677815-1e62-4823-8a89-c2bc623da314 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.047166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.048634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.048914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.049186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.049829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.051767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.059994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d29fb854-43a3-4969-a54f-6501696f320e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.061380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d29fb854-43a3-4969-a54f-6501696f320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.069409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 788/1557] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.070732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f704-2b1b-4af4-a8af-c81a8d9dd28a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.071038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f704-2b1b-4af4-a8af-c81a8d9dd28a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.071367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f704-2b1b-4af4-a8af-c81a8d9dd28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.087873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 770/1558] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.088683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.100416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c469f704-2b1b-4af4-a8af-c81a8d9dd28a None None] MFA Rules not processed for user `ea2ee7a078a140adad2559bc9add3486`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.101608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c469f704-2b1b-4af4-a8af-c81a8d9dd28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.107174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.154122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d064a-ac1c-4e8d-bf41-6f49258fbc69 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.159080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.159690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.159974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.160247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.160878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.161896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:27.161896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:16:27.161896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:16:27.163145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc6de8-f743-43e4-aedc-8aa21f7b3572 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.172497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 789/1559] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.172497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97761503-ef68-4213-ba3b-36091d23b9dc None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.172497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97761503-ef68-4213-ba3b-36091d23b9dc None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.172497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97761503-ef68-4213-ba3b-36091d23b9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.186449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 771/1560] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.187776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db693-96ce-4463-b596-e509cfce96d4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.188183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db693-96ce-4463-b596-e509cfce96d4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.188467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db693-96ce-4463-b596-e509cfce96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.192523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-97761503-ef68-4213-ba3b-36091d23b9dc None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.193731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-97761503-ef68-4213-ba3b-36091d23b9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.202474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 790/1561] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.202474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d831ca-655e-4aa1-a37e-9636d6728943 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.202474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d831ca-655e-4aa1-a37e-9636d6728943 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.202474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d831ca-655e-4aa1-a37e-9636d6728943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.210234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c37db693-96ce-4463-b596-e509cfce96d4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.210234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c37db693-96ce-4463-b596-e509cfce96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.217511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 772/1562] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.218800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.219167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.219365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.225327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e0d831ca-655e-4aa1-a37e-9636d6728943 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.226524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e0d831ca-655e-4aa1-a37e-9636d6728943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.234741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 791/1563] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.236042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.236253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.236505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.243602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.245005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.253702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 773/1564] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.257481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.257592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.257949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.265298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd20e5-3f21-495f-b021-166277e5d35f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.269120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 792/1565] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.270019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.270623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.270905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.271209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.271874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.273344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.274354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.283755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59c41-d6d9-4721-8699-80cf6f4eff98 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.288432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.288986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.289263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.289535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.290250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.292196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2423e9-19dd-4985-8e5d-382abbc2e75a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.300380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 774/1566] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.300380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.307923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825c84-13f9-4d45-9812-c96d76878adf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.314059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.314661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.314940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.315247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.315894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.317509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e49d-0472-487d-95c1-a025f0bd5e80 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.319925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 793/1567] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.321212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.321552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.321839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.328581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 775/1568] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:27.330189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.330530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.331882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.342689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.344005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.351091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:27.352254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:27.407756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 794/1569] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.407756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.411580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 776/1570] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:27.412474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.414450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d9ffa-1208-4910-a487-2e346969e197 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.419384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.419975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.420256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.420530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.421174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:27.421478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.422393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6a1d-c043-4b3e-a6d1-ffea3d5f062a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.423131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.427274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.427859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.428169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.428450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.429089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:27.429392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.430968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.435512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 795/1571] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:27.436514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.442857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 777/1572] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:27.443699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.452694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288df3-4710-4d4d-8d4a-2e8b5ff0de2f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.455092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb087-8a36-4807-ab93-c2d1c4758e45 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.457593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.458195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.458481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.458755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.459430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:27.459689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.459801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.460270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.460554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.460830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.461325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.461441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.463040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.466076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.474649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 796/1573] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:27.475287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.478428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 778/1574] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:27.478428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.488651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073707c-e21f-4685-baef-9b215113c545 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.491232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f60f4-1961-40a4-8eb4-600a62cac2df admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.493456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.494053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.494333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.494605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.495331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.496651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.497513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.497632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.497796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.498074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.498711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.500335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.515766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 779/1575] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:27.515766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.521618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 797/1576] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.522735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.523269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840ad2e-9dc6-4b39-a769-6cf4c9e00471 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.528580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.529172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.529466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.529724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.530367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:27.530670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.532304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.533632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9302-b447-483d-bba7-f4706ee1e8c6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.538427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.539433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.539433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.539662 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.540234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:27.540541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.542125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.544795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 780/1577] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:27.545416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.559096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 798/1578] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:27.559280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353f65-11ea-4892-9d30-f0c09d5d56c4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.559380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.559972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.560638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.561081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.561353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.561976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.564190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.567152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5cc29-9ba4-47fc-baea-0e977c552177 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.571874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.572532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.572882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.573229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.573946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.576833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.583150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.596265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 781/1579] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.596265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.612118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 799/1580] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.612118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.658604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5244c-9fdf-4dc7-8406-304bbcdfd2b0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.671919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbc1f-d516-48ab-888a-bc5c4001de97 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.676616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.677239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.677521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.677796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.678415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.680366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.708422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 800/1581] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.709421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.716326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.717021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.717372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.717709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.718363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.720030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.732986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 782/1582] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:27.732986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.740341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270badd5-3459-4589-9f41-3afbf40639a8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.776490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300564ce-d32b-4dc9-9be2-f99623b599fc admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.781343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.781993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.782266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.782533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] PATH_INFO: `/v3/projects/74e04e19bc1045a2adfbaa3d7c881fd1/users/1080f0e19dd84503af28318412466485/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.792631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.797105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e04e19bc1045a2adfbaa3d7c881fd1, user_id=1080f0e19dd84503af28318412466485, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.798178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:27.798178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:16:27.798178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:16:27.800058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.800207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.800718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.801426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.801975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.802998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.804970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.813551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 801/1583] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:27 2022] PUT /identity/v3/projects/74e04e19bc1045a2adfbaa3d7c881fd1/users/1080f0e19dd84503af28318412466485/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:27.814387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.819204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 783/1584] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:27.819204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.830080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc414db-7749-4670-a748-a35af01beff3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.876819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.882584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac1a9-5b16-4b1b-b864-b3b44bfb854c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.889126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.889820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.890101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.890376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.891030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.891621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.892233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.892553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.892827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.892936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.893448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.895413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.919358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 802/1585] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.920295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.922681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 784/1586] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:27.923374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:27.983319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8f87-adba-4285-84f8-c058209deefc admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.984793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fac5-3ccf-457f-82ed-286b736d7a2a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:27.987910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.988509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.988787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.989054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.989465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:27.989704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.990064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:27.990347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:27.990623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:27.991316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:27.991659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:27.993216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.016638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 803/1587] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:28.017460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 785/1588] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:27 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:28.018301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.020388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.028149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148dcda-3265-4c84-a433-147503de8e33 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.030100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e43-e070-47c3-86f0-a2cc578a5c02 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.032851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.033498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.033774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.034106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] PATH_INFO: `/v3/projects/e665504b825a45dfa1596ab32fd9dc5d/users/7b0d4009ebc34bed815d512708254892/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.035331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.035937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.036215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.036491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.037140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.039217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faf571-98ab-48b0-bf64-f7bd0c73bb67 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.050358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e665504b825a45dfa1596ab32fd9dc5d, user_id=7b0d4009ebc34bed815d512708254892, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.054568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.062057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 804/1589] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:28.063476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.063767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.064051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.069128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 786/1590] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/e665504b825a45dfa1596ab32fd9dc5d/users/7b0d4009ebc34bed815d512708254892/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.069914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.083737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:28.084966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:28.126046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:28.145142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12738-ab8b-47cb-bb10-347d8701b4c3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.146668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 805/1591] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:28.147583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.153462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.154246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.154632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.155037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] PATH_INFO: `/v3/projects/16123d1babc2449888387707bf109959/users/3355befe97e04d36826ad1ae651d3631/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.157136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172961f1-13af-4655-a4f7-728275c96ac6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.161868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.162467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.162778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.163082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.163726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.165646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.171086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16123d1babc2449888387707bf109959, user_id=3355befe97e04d36826ad1ae651d3631, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.173736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.187611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 787/1592] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/16123d1babc2449888387707bf109959/users/3355befe97e04d36826ad1ae651d3631/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.190739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.190861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 806/1593] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:28.190861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.199231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46995-92b5-46a6-8755-62c0da4f94d5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.233257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:28.254142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7794-c9ef-48fc-8ad6-d1921b45b638 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.258879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.259552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.259746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.259857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.260093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.260385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.260665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.260769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.260940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.261605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.262785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.263294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.276250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 807/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.276250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.283925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6520-2e42-400c-913b-a0287247a0e8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.288863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 788/1595] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:28.288863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.291095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.291712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.291971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.292243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.292886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.295253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860865e-d205-4168-8ec7-6ed35fb1d6c1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.296942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a718-e829-4fc8-b55a-044d9c53a303 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.301721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.302344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.302627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.302904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.303581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.305172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.308359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 808/1596] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.308359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.308359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.308359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.318656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 789/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.318656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.335419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] MFA Rules not processed for user `7b0d4009ebc34bed815d512708254892`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:28.336647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:28.372557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52730e4-8006-47e0-8331-65f7973bb130 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.376208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.376811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.377094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.377366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.388018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.389465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.399064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 790/1598] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:28.399856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.400135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 809/1599] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:28.404640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.409885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc927f-bd76-445c-aa16-79a61542c6bb service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.415725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637efae4-150e-4fd8-be49-e8637ee76ab0 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.419388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.421122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.421258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.421858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.422141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.422417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.423163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.423387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.423846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.424664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.424805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.428406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.438049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 810/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.438892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.454704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 791/1601] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.454704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.455202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b2819-f95f-4c8d-bdb3-4aaa44863403 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.459249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.459936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.460385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.460788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.461522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.463783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.467625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db90a0-56b1-4dd6-875d-79725c47435d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.472828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.473653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.473938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.474218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.474690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 811/1602] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.474872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.476538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.479180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.489264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 792/1603] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.489942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.490686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0381-af85-4883-a45d-9bc04da138d2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.495836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.497898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.498180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.498728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.499418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.501038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e513f-8448-4dcd-b109-23b6875aeb09 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.501519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b3e6-e5b0-4cee-845d-9931b1e232e3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.507654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.508349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.508707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.509052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.509766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.511943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.513282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 812/1604] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.516649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b0cc-ad09-4330-8152-fb3105392f04 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.516649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b0cc-ad09-4330-8152-fb3105392f04 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.516649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b0cc-ad09-4330-8152-fb3105392f04 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.516902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 813/1605] 10.222.0.30 () {54 vars in 962 bytes} [Tue Aug 30 16:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:16:28.517630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b0cc-ad09-4330-8152-fb3105392f04 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.530677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 793/1606] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.531171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b0cc-ad09-4330-8152-fb3105392f04 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.531945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.538749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.539403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.539745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.540084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.540792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.542469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.543226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78418-b277-4c49-8c51-35ecfd0109d4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.549701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.550387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.550743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.550915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] PATH_INFO: `/v3/projects/16123d1babc2449888387707bf109959/users/3355befe97e04d36826ad1ae651d3631/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.553196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16123d1babc2449888387707bf109959, user_id=3355befe97e04d36826ad1ae651d3631, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.554205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 814/1607] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.557447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.557570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.564255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:28.568611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2e167-a20e-44b6-8d2f-2aa4ba72c301 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.569366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 794/1608] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/16123d1babc2449888387707bf109959/users/3355befe97e04d36826ad1ae651d3631/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.570784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.648627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.649292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.649629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.649909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] PATH_INFO: `/v3/projects/8b36ad37233a4f95a65ef6dc90be2ae2/users/7acceb819010462cb3a887d9661e4f68/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.660293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ce8b-cd48-474d-990d-08d5c1b9bd9a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.665212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.665603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:28.665831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.666116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.666389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.667112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.669883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.672462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b36ad37233a4f95a65ef6dc90be2ae2, user_id=7acceb819010462cb3a887d9661e4f68, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.674711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8116952-8204-4a59-b877-c3bade29d53e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.682302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 795/1609] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:28.683491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.693436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 815/1610] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/8b36ad37233a4f95a65ef6dc90be2ae2/users/7acceb819010462cb3a887d9661e4f68/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.694943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.695317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.695758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.700802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672711d-08f5-45e7-b10a-be20bb9a44cd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.738736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:28.740095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:28.767106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.768813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.769180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.769527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] PATH_INFO: `/v3/projects/12770db0a629489db51f1f1dc6859fb7/users/7918c9efb8504d2197556022eb9dffc1/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.788376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12770db0a629489db51f1f1dc6859fb7, user_id=7918c9efb8504d2197556022eb9dffc1, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.791507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.807897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 796/1611] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/12770db0a629489db51f1f1dc6859fb7/users/7918c9efb8504d2197556022eb9dffc1/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.808503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.811998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 816/1612] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:28.820744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.844517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772f6d-aa68-4ef4-925a-71f2d95ef58e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.899002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8ef2-86cc-4f65-8bcc-7ba734e10fb5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:28.906248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.907369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.907658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.907933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] PATH_INFO: `/v3/projects/0ad51292af7445f3897a967e272dc30e/users/76fcc4cc3b084b2a831483ec1400139f/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.916213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:28.917108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.918003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.918003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] PATH_INFO: `/v3/projects/e7545ca26f894f3f86ca66a3ac5cc717/users/6e92282873df4a6fa7511c6c4cdab140/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.927961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad51292af7445f3897a967e272dc30e, user_id=76fcc4cc3b084b2a831483ec1400139f, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.931608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3d746-16b2-439d-a093-754b108dda0c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.938677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7545ca26f894f3f86ca66a3ac5cc717, user_id=6e92282873df4a6fa7511c6c4cdab140, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:28.941711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:28.947542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 797/1613] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/0ad51292af7445f3897a967e272dc30e/users/76fcc4cc3b084b2a831483ec1400139f/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.949133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339944-d71a-4518-a784-f05a5a5a125a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:28.950212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339944-d71a-4518-a784-f05a5a5a125a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:28.950738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339944-d71a-4518-a784-f05a5a5a125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:28.964029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:28.968915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 817/1614] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/e7545ca26f894f3f86ca66a3ac5cc717/users/6e92282873df4a6fa7511c6c4cdab140/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:28.972169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:28.989720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-45339944-d71a-4518-a784-f05a5a5a125a None None] MFA Rules not processed for user `3355befe97e04d36826ad1ae651d3631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:28.991043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-45339944-d71a-4518-a784-f05a5a5a125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.035907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.051684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee63953-5956-4c52-aa0b-31c8e93c4e27 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.057791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.058462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.058779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.059094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] PATH_INFO: `/v3/projects/3040209e48904acdb2dee0fa4152c48d/users/959595d95fc3443088b52c938aa4948c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.076681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 798/1615] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.078321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.078774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.079081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.079996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3040209e48904acdb2dee0fa4152c48d, user_id=959595d95fc3443088b52c938aa4948c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.083992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9173-c7b0-44d7-b4a6-74755770e9ee admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.101801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:29.112765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 818/1616] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:28 2022] PUT /identity/v3/projects/3040209e48904acdb2dee0fa4152c48d/users/959595d95fc3443088b52c938aa4948c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:29.112979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.113082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66615-d409-4e4e-ba09-20bfe9c7846e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.113082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66615-d409-4e4e-ba09-20bfe9c7846e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.113082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66615-d409-4e4e-ba09-20bfe9c7846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.132455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5aa66615-d409-4e4e-ba09-20bfe9c7846e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:29.134291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5aa66615-d409-4e4e-ba09-20bfe9c7846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.186514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 799/1617] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.187480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.213111 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 819/1618] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.214765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697e7a-b24d-49b3-af0d-6093b96deaee None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.215159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697e7a-b24d-49b3-af0d-6093b96deaee None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.215667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697e7a-b24d-49b3-af0d-6093b96deaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.249042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-71697e7a-b24d-49b3-af0d-6093b96deaee None None] MFA Rules not processed for user `76fcc4cc3b084b2a831483ec1400139f`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:29.252828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-71697e7a-b24d-49b3-af0d-6093b96deaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.297263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910935b-62c5-4096-8a33-bb092dc5ebc7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.304596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.305227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.305227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.305431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.334161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.351049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 820/1619] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.352696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618348d-206a-4c7f-b019-1cef2b02af9f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.353192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618348d-206a-4c7f-b019-1cef2b02af9f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.353614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618348d-206a-4c7f-b019-1cef2b02af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.373876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.375987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.378116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5618348d-206a-4c7f-b019-1cef2b02af9f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:29.379840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5618348d-206a-4c7f-b019-1cef2b02af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.389622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 800/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:29.391329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.393444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 821/1621] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.394968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.395282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.395553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.430394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] MFA Rules not processed for user `959595d95fc3443088b52c938aa4948c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:29.432753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.469361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4234dc-67a7-486c-855b-3772488d08c8 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.481348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.482130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.482487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.482757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.518526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.568825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.569567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 822/1622] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:29.570562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.571014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.574020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.583901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 801/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:29.584655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.586124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:29.688551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc11bd-9b3a-418f-b4d4-9b7b28279958 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.707116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.708648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.709092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.709693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.730684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.732125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec4448-a504-432b-a86b-74e2322c03c1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.733493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.749226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.749862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.750153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.752155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.773839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 802/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:29.776391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.785305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.804691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.817854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b069d-e2c7-46fb-b71d-8c31c8764e85 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.831335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.835693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 823/1625] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:29.836908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.842454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.842750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.843123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.844149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.846275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.849743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36131-10a0-4ab4-98fd-b8092a01c38a service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.854198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.855198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.855647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.856643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.868542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.869868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.872602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:29.887450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 824/1626] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:29.888623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.892014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 803/1627] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:29.893529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:29.901936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812abe75-e0e0-47d6-9036-af00516ef5e6 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:29.976914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:29.978262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:29.978700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:29.979198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:29.980116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:29.982939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1bb35-a5f6-4d1d-a427-db596230372b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.006796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49d83-7c24-450c-b1cd-c4d0ad0ed507 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.016397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.017297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.017895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.018656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] PATH_INFO: `/v3/users/ea2ee7a078a140adad2559bc9add3486` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.020638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2ee7a078a140adad2559bc9add3486)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.022058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 825/1628] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:29 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:30.023540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.023698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2dfb-3983-4a8f-b0c9-6f396d7bba26 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.023982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2dfb-3983-4a8f-b0c9-6f396d7bba26 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.024431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2dfb-3983-4a8f-b0c9-6f396d7bba26 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.031714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 826/1629] 10.222.0.30 () {54 vars in 912 bytes} [Tue Aug 30 16:16:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:16:30.032818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2dfb-3983-4a8f-b0c9-6f396d7bba26 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.107573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2ee7a078a140adad2559bc9add3486'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:30.112077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2dfb-3983-4a8f-b0c9-6f396d7bba26 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.118486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.119336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.119802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.120224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.121453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.124558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.136766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2ee7a078a140adad2559bc9add3486'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:30.137654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:30.155472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2ee7a078a140adad2559bc9add3486'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:30.160972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 827/1630] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:30 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:30.160972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.171350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2ee7a078a140adad2559bc9add3486'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:30.172148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5e65463a-2dd2-4035-a90b-f3ef1994ef51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2ee7a078a140adad2559bc9add3486'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:30.172594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48c834-b11a-45e0-a6f9-bb4a067388ae admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.177711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.178422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.178711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.179099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.179814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.182232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.188465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 804/1631] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:29 2022] DELETE /identity/v3/users/ea2ee7a078a140adad2559bc9add3486 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:30.189986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4699-b34c-4927-8575-4d23499c81a4 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.190630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4699-b34c-4927-8575-4d23499c81a4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.191011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4699-b34c-4927-8575-4d23499c81a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.218635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 828/1632] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:30 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:30.220577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.226036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.233883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6ebd4699-b34c-4927-8575-4d23499c81a4 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:30.235278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6ebd4699-b34c-4927-8575-4d23499c81a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.240345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296c729-68d7-4c93-a2da-bf1615cd82e1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.333713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.334381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.334673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.335160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.335694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.336461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 805/1633] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:30.337873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.345174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.345603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.347079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.357338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 829/1634] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:30.361819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.364138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.367948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:30.376026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:30.378551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.380462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f34bc-9fab-4421-a664-1cc4bdcf2e4e admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.385531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.386011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.386575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.386575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.388454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.389934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.394316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 806/1635] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:30.395244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.397065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.408845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 830/1636] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:30.409776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.422115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75635ca1-d266-4808-9cdf-1f10c56c7842 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.428094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.428822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.429204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.429374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] PATH_INFO: `/v3/projects/5e15eb4f92354f5fbd58ae574457b16a/users/276c0038a71749fbb72d1ed871a60d5a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.570441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e15eb4f92354f5fbd58ae574457b16a, user_id=276c0038a71749fbb72d1ed871a60d5a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.570441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.570441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 831/1637] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:30 2022] PUT /identity/v3/projects/5e15eb4f92354f5fbd58ae574457b16a/users/276c0038a71749fbb72d1ed871a60d5a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:30.570441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.570441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:30.577138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2793912-1bff-4165-92c6-34cbafc9a221 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.627014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37283a-3e84-481f-a327-b03e8ac07b6c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.632895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.633895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.634486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.634910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.643858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.644565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.644917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.645275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.698801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:30.719592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.721402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.735245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 832/1638] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:30.736308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.741502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.743187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.753183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e247ff1-56d2-4c10-a36e-fcdddef3f4ac service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.759972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.760647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.760929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.761208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] PATH_INFO: `/v3/projects/1c8ef22ff95b473b9d5e653494acc52f/users/cd71a41d24c740aab5106d8a7780ba6a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.762952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 807/1639] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:30.764077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.782530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896579f4-9964-442f-ac8d-691a5e145f17 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.793240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.794537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.795722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.796009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.797650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.800715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.801043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8ef22ff95b473b9d5e653494acc52f, user_id=cd71a41d24c740aab5106d8a7780ba6a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.804692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.829133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 808/1640] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:30.833245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.850403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9fb3-b801-4c5b-941c-89ab9a6066d2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.858323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 833/1641] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:30 2022] PUT /identity/v3/projects/1c8ef22ff95b473b9d5e653494acc52f/users/cd71a41d24c740aab5106d8a7780ba6a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:30.862318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:30.954369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:30.977746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.978563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.978857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.979167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] PATH_INFO: `/v3/projects/5e15eb4f92354f5fbd58ae574457b16a/users/276c0038a71749fbb72d1ed871a60d5a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.983061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec99b-0061-4377-a471-ce6ec73f14c0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:30.987183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e15eb4f92354f5fbd58ae574457b16a, user_id=276c0038a71749fbb72d1ed871a60d5a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.989898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799ce2-7544-41e9-bc6a-dd3d9f3425b1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:30.992806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:30.993439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:30.993718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:30.993992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:30.994789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:30.997574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:31.015552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 809/1642] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:30 2022] PUT /identity/v3/projects/5e15eb4f92354f5fbd58ae574457b16a/users/276c0038a71749fbb72d1ed871a60d5a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:31.026345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:31.026639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:31.026922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:31.059273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 834/1643] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:31.061445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:31.094908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa581e-227d-43ad-8176-f26ac60cd2af admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:31.115049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] MFA Rules not processed for user `276c0038a71749fbb72d1ed871a60d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:31.116396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:31.251778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:31.252481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:31.252766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:31.253045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] PATH_INFO: `/v3/projects/1c8ef22ff95b473b9d5e653494acc52f/users/cd71a41d24c740aab5106d8a7780ba6a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:31.260454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8ef22ff95b473b9d5e653494acc52f, user_id=cd71a41d24c740aab5106d8a7780ba6a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:31.263794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42a49-ddc0-4070-8936-e5382bace230 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:31.302722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 835/1644] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:31 2022] PUT /identity/v3/projects/1c8ef22ff95b473b9d5e653494acc52f/users/cd71a41d24c740aab5106d8a7780ba6a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:31.314030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:31.314323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:31.314603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:31.323036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 810/1645] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:31.342449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:31.350053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:31.380968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] MFA Rules not processed for user `cd71a41d24c740aab5106d8a7780ba6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:31.382222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:31.477161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:31.489318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff501a30-c933-476b-be18-3e12766feb52 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:31.548597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 836/1646] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:16:31.549748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:31.551724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:31.634472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:31.635380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:31.637849 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:31.638410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:31.734656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d317a3-e9f4-411f-94a9-4482001dfd87 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:31.751595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:31.752273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:31.752968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:31.753803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] PATH_INFO: `/v3/projects/857e4026c9214f0dad1fca94fe68a073` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:31.765903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857e4026c9214f0dad1fca94fe68a073)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:31.768853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:31.770163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:31.852921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:31.852921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:31.878003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 811/1647] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:31.878385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857e4026c9214f0dad1fca94fe68a073', 'request_id': 'req-2104ac74-ced4-4751-a4d4-fabd76968cb5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:31.880144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:31.890316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857e4026c9214f0dad1fca94fe68a073', 'request_id': 'req-2104ac74-ced4-4751-a4d4-fabd76968cb5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:31.908379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea297e-6582-4c9c-bd82-03d618830ac7 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:31.911418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857e4026c9214f0dad1fca94fe68a073', 'request_id': 'req-2104ac74-ced4-4751-a4d4-fabd76968cb5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:31.930722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] The token cache is being invalidate because project 857e4026c9214f0dad1fca94fe68a073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:31.931040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:31.931732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:31.935081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 837/1648] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:31 2022] DELETE /identity/v3/projects/857e4026c9214f0dad1fca94fe68a073 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:31.938738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:31.940442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.009700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:32.010853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.011584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.011870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.015921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.077981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ac74-ced4-4751-a4d4-fabd76968cb5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:32.093295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:32.093972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.094255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.094631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] PATH_INFO: `/v3/users/3355befe97e04d36826ad1ae651d3631` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.098406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3355befe97e04d36826ad1ae651d3631)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:32.099585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: WARNING py.warnings [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:32.099585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: warnings.warn(msg) Aug 30 16:16:32.099585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: Aug 30 16:16:32.100947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:32.122191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:32.166150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:32.184551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:32.209334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 812/1649] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:32.277542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3355befe97e04d36826ad1ae651d3631'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:32.286812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:32.289598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.306519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3355befe97e04d36826ad1ae651d3631'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:32.312967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed14b-9b62-4fa1-8e41-8514a47e263c service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:32.327878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3355befe97e04d36826ad1ae651d3631'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:32.328535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3355befe97e04d36826ad1ae651d3631'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:32.334608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:32.335288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.336697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.337692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.345027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.384368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3355befe97e04d36826ad1ae651d3631'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:32.405799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 838/1650] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:31 2022] DELETE /identity/v3/users/3355befe97e04d36826ad1ae651d3631 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:32.434897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:32.437409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.510788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:32.513607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baeb42-4947-4f8b-8225-6071c0957399 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:32.543211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 813/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:32.561505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941b9a-43f4-4d5e-b6eb-170c61176800 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:32.566018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:32.566638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.567667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.567947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.570444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.718791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e9d9f-3dd0-4716-a578-27a08c6f39e6 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.719359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e9d9f-3dd0-4716-a578-27a08c6f39e6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.720027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e9d9f-3dd0-4716-a578-27a08c6f39e6 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.722773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 814/1652] 10.222.0.30 () {54 vars in 962 bytes} [Tue Aug 30 16:16:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:16:32.747018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af460-7968-41ee-a032-097e394bb7db None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:32.747996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af460-7968-41ee-a032-097e394bb7db None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:32.748599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af460-7968-41ee-a032-097e394bb7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:32.776038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:32.801617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6aeb-f2ad-4f35-adc1-d5c2cf4205a7 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:32.816222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-298af460-7968-41ee-a032-097e394bb7db None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:32.824262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-298af460-7968-41ee-a032-097e394bb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:32.831660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 839/1653] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:32.889273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:33.133183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 815/1654] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Aug 30 16:16:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:16:33.139687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2609900-9d08-4d0a-8d41-9152b0c076c2 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:33.140226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2609900-9d08-4d0a-8d41-9152b0c076c2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:33.140732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2609900-9d08-4d0a-8d41-9152b0c076c2 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:33.142560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 840/1655] 10.222.0.30 () {54 vars in 912 bytes} [Tue Aug 30 16:16:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:16:33.149182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:33.151303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:33.153179 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:33.253082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:33.255607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:33.273496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 816/1656] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:33.292867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2609900-9d08-4d0a-8d41-9152b0c076c2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:33.306093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2609900-9d08-4d0a-8d41-9152b0c076c2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:33.312141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:33.312141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:33.312455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:33.312716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:33.327620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:33.329463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731471b-68f8-46ad-b729-6eaeb3b8378a service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:33.343971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 841/1657] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:33.568646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:33.570333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:33.778809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cb874-6e64-4890-ae11-126ebd08d4e9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:33.792483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:33.793743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:33.795812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:33.796230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] PATH_INFO: `/v3/projects/16123d1babc2449888387707bf109959` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:33.801054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16123d1babc2449888387707bf109959)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:33.803331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: WARNING py.warnings [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 16:16:33.803331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: warnings.warn(msg) Aug 30 16:16:33.803331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: Aug 30 16:16:33.817298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:33.920613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16123d1babc2449888387707bf109959', 'request_id': 'req-0a98a99f-3e7f-4234-9d41-199cdc488723'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:33.941107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16123d1babc2449888387707bf109959', 'request_id': 'req-0a98a99f-3e7f-4234-9d41-199cdc488723'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:33.957877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16123d1babc2449888387707bf109959', 'request_id': 'req-0a98a99f-3e7f-4234-9d41-199cdc488723'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:33.987336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] The token cache is being invalidate because project 16123d1babc2449888387707bf109959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:33.987739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:33.988618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0a98a99f-3e7f-4234-9d41-199cdc488723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:34.008364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 817/1658] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:33 2022] DELETE /identity/v3/projects/16123d1babc2449888387707bf109959 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:34.013583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.014049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.014187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.084274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:34.085554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:34.164078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:34.333911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 842/1659] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:34.343812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.344081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.344338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.370118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:34.371874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:34.393859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.394376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 818/1660] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:34.405505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b975d-1287-41d7-8591-c339324851c4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:34.411456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:34.412142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.412491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.412827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.413545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:34.413915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:34.416386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:34.450773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 843/1661] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:34.456090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.471173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b6e96-3bc3-4c8a-a45d-ba0307c6baff None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:34.485534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:34.486174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.486457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.486733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.487407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:34.489560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:34.556846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 819/1662] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:34 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:34.558114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.588833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a48467-10e4-4ff7-a00a-523cbf31b486 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:34.728618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:34.732727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.733468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.733665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.734791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:34.739930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:34.796863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 844/1663] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:34 2022] POST /identity/v3/users => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:34.802062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.822952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ae36-53cc-4fba-b227-69a7e8e12fcd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:34.839177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:34.840774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.841280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.841795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.851719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:34.860720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:34.867972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:34.909229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 820/1664] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:34.913773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.928767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e1c3-eadc-43e0-9b7a-ed3105f1f83a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:34.944174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:34.945169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:34.946840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:34.947360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:34.950128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:34.954843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6491a1-fe9f-45d9-8a53-c91bd9b0fedd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:34.974297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 845/1665] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:34.978517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:34.990730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603e8e-27ed-4d18-8623-52e4918c844e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:35.000287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:35.001384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.001707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.002159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] PATH_INFO: `/v3/projects/02bcc9fdd18a47359d560cc9d35b1406/users/a9aeb232914c42d1af686c5491c5e3a7/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.026932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bcc9fdd18a47359d560cc9d35b1406, user_id=a9aeb232914c42d1af686c5491c5e3a7, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:35.036127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:35.072517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.073136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.073136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.073265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 821/1666] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:34 2022] PUT /identity/v3/projects/02bcc9fdd18a47359d560cc9d35b1406/users/a9aeb232914c42d1af686c5491c5e3a7/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:35.139126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] MFA Rules not processed for user `a9aeb232914c42d1af686c5491c5e3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:35.142501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:35.256937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 846/1667] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:16:35.261174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:35.449830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f875b-8292-4714-b664-1ce8b4848de3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:35.470897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:35.472676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.472967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.473238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.473901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:35.482715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:35.556985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 822/1668] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:35 2022] POST /identity/v3/projects => generated 399 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:35.557469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:35.579339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5938b-0b90-4bdf-ae6c-c3ad0509cde5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:35.623884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:35.720132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:35.720817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.721108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.721806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.722365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:35.724803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:35.776380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 847/1669] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:35 2022] POST /identity/v3/users => generated 306 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:16:35.783312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:35.803124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5317-8704-4715-a23c-22144fb99ca4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:35.816543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:35.817244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.817526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.817798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.820526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:35.825846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:35.860784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 823/1670] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:35.865139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:35.884077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65580-0cb1-4009-93bc-14202db0e772 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:35.894845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:35.895648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:35.896025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:35.896394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] PATH_INFO: `/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08/users/0c382ca05f974be49fe707d061abf03a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:35.948012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a67f9458ac4dec9a895d1ae8da4d08, user_id=0c382ca05f974be49fe707d061abf03a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:35.952103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:35.972304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 848/1671] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:35 2022] PUT /identity/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08/users/0c382ca05f974be49fe707d061abf03a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:35.976246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:36.015227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489baba-0f3b-458c-b8aa-5455527b9709 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:36.119507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:36.120147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:36.120423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:36.120695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:36.132168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:36.132168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac4d7-1d17-44ee-a93d-046b1f7fa67d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:36.162998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 824/1672] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:36.168334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:36.196091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7deeb-04b8-4d85-9f33-03ab2ef04e08 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:36.219314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:36.219993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:36.220273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:36.220548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] PATH_INFO: `/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08/users/0c382ca05f974be49fe707d061abf03a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:36.230791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a67f9458ac4dec9a895d1ae8da4d08, user_id=0c382ca05f974be49fe707d061abf03a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:36.237563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:36.305150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 849/1673] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:36 2022] PUT /identity/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08/users/0c382ca05f974be49fe707d061abf03a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:36.318174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:36.318659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:36.319118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:36.392401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] MFA Rules not processed for user `0c382ca05f974be49fe707d061abf03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:36.394282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:36.525421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:36.666525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 825/1674] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:36.679022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:36.681188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:36.889509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8fc3-a2d7-41f3-86ca-622311706af8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:36.915419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:36.916235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:36.916525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:36.916798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:36.948095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:36.950145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:36.995396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 850/1675] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:37.180906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:37.223513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e9d59-487d-406b-b958-5a3e75d7cabc None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:37.249657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:37.251836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:37.252221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:37.253700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:37.430962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:37.433237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:37.481661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 826/1676] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:37.697626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:37.699158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:37.758920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:37.760820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:37.897913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66111eba-9f35-418b-b05e-e283ff550305 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:37.911195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:37.911934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:37.912217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:37.912499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] PATH_INFO: `/v3/users/76fcc4cc3b084b2a831483ec1400139f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:37.915721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fcc4cc3b084b2a831483ec1400139f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:37.917921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:37.946340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf43a7-938a-4a3d-8a3d-238267678efd service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:37.960022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:37.960671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:37.960951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:37.961236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] PATH_INFO: `/v3/users/7b0d4009ebc34bed815d512708254892` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:37.968266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0d4009ebc34bed815d512708254892)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:37.969806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:37.973159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:38.015166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fcc4cc3b084b2a831483ec1400139f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.030365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fcc4cc3b084b2a831483ec1400139f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.044887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fcc4cc3b084b2a831483ec1400139f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.047281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fcc4cc3b084b2a831483ec1400139f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.081994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-37acdf55-43cc-40a3-8525-473f61e88c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fcc4cc3b084b2a831483ec1400139f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.099140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 851/1677] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:37 2022] DELETE /identity/v3/users/76fcc4cc3b084b2a831483ec1400139f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:38.106778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:38.107288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:38.107706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:38.134873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0d4009ebc34bed815d512708254892'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.152104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:38.156802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:38.177058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0d4009ebc34bed815d512708254892'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.180196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:38.194497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0d4009ebc34bed815d512708254892'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.210716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0d4009ebc34bed815d512708254892'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.212032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-06ab0f8e-c4be-43ad-9617-3dc7bdc0b157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0d4009ebc34bed815d512708254892'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:38.230462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 827/1678] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:37 2022] DELETE /identity/v3/users/7b0d4009ebc34bed815d512708254892 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:38.235161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:38.235600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:38.236031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:38.331743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 852/1679] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:38.333930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:38.342454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:38.408625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:38.410198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:38.536346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 828/1680] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:38.554853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:38.556591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:38.610120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50e0e5-4857-4baa-80c2-94c0da9e7ef1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:38.713160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef71f-765f-47df-acb7-40aec97967fd None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:38.727587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:38.729629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:38.729629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:38.730079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:38.764576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:38.773795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:38.776382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:38.777013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:38.777599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:38.778512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:38.798459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:38.798750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 829/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:38.814593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:38.816101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:38.833931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 853/1682] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:16:41.242190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:41.246760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:41.284592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632fab7-a7d0-4173-93a9-3857b1b11793 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:41.292108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:41.293811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:41.294491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:41.295091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] PATH_INFO: `/v3/projects/0ad51292af7445f3897a967e272dc30e` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:41.297902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad51292af7445f3897a967e272dc30e)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:41.305745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:41.439319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad51292af7445f3897a967e272dc30e', 'request_id': 'req-9aa6317d-7185-49b5-8898-1b0d4fee1962'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.461104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad51292af7445f3897a967e272dc30e', 'request_id': 'req-9aa6317d-7185-49b5-8898-1b0d4fee1962'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.481104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad51292af7445f3897a967e272dc30e', 'request_id': 'req-9aa6317d-7185-49b5-8898-1b0d4fee1962'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.497506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:41.499509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:41.524421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4ae2-e3ec-4258-a8ee-eca9be2f6989 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:41.532333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] The token cache is being invalidate because project 0ad51292af7445f3897a967e272dc30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:41.532664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.552977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.552977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 830/1683] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:41 2022] DELETE /identity/v3/projects/0ad51292af7445f3897a967e272dc30e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:41.557397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:41.559960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:41.583108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:41.750609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6317d-7185-49b5-8898-1b0d4fee1962 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:41.751644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:41.752380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:41.752720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:41.753067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] PATH_INFO: `/v3/projects/e665504b825a45dfa1596ab32fd9dc5d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:41.756149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e665504b825a45dfa1596ab32fd9dc5d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:41.757735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:41.759869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:41.763074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:41.763662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] PATH_INFO: `/v3/users/276c0038a71749fbb72d1ed871a60d5a` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:41.764898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:41.765533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276c0038a71749fbb72d1ed871a60d5a)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:41.767817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:41.896755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e665504b825a45dfa1596ab32fd9dc5d', 'request_id': 'req-3526b51f-135f-4a2d-9aeb-d6accd688de1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.897646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276c0038a71749fbb72d1ed871a60d5a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.910514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e665504b825a45dfa1596ab32fd9dc5d', 'request_id': 'req-3526b51f-135f-4a2d-9aeb-d6accd688de1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.919595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e665504b825a45dfa1596ab32fd9dc5d', 'request_id': 'req-3526b51f-135f-4a2d-9aeb-d6accd688de1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.941707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] The token cache is being invalidate because project e665504b825a45dfa1596ab32fd9dc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:41.942112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.942855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3526b51f-135f-4a2d-9aeb-d6accd688de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.945018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 854/1684] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:41 2022] DELETE /identity/v3/projects/e665504b825a45dfa1596ab32fd9dc5d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:41.952084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:41.952463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:41.952972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:41.957178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276c0038a71749fbb72d1ed871a60d5a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.984312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276c0038a71749fbb72d1ed871a60d5a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:41.993522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:41.993522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:42.005603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276c0038a71749fbb72d1ed871a60d5a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:42.006549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c8c3aa00-72da-4a0d-98a0-f679520689c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276c0038a71749fbb72d1ed871a60d5a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:42.026490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 831/1685] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:41 2022] DELETE /identity/v3/users/276c0038a71749fbb72d1ed871a60d5a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:42.146421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 855/1686] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:42.155092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:42.155739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:42.156320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:42.198080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:42.202095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:42.317433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 832/1687] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:42.321463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:42.345653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a579c-ca0e-4a4e-b533-726fa4e8fc8a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:42.363411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:42.367193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:42.367764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:42.369637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:42.370607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:42.373976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:42.375630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:42.412375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 856/1688] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:42.427628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:42.461411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2551d-711c-4bf2-b1b1-ab7b75b22b97 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:42.467136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:42.482519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:42.483861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:42.484320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:42.485416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:42.487580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2062-4572-4f05-ad9e-e2046b15c9a4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:42.556246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 833/1689] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:42.560979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:42.582660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b2e3-cf17-45af-8cac-2b70be9e319a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:42.610430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:42.778556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:42.778834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:42.779217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:42.821920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:42.822554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:42.830496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:42.830789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:42.833628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:42.837647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:42.850768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:42.888629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] MFA Rules not processed for user `1080f0e19dd84503af28318412466485`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:42.891384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:42.948454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 857/1690] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:42 2022] POST /identity/v3/users => generated 293 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:42.950089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.015351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566a9c-94e2-4661-a23d-2e5047e158a7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:43.045059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:43.046962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.055937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.056254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.057163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:43.064734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:43.105275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 858/1691] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:43.111832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.149190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b867-4b11-4eb3-aafb-3c05de4b995d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:43.175813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:43.176440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.176725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.176987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.178586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:43.180687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:43.211640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 859/1692] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:43.216215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.227107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 834/1693] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:43.247180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ba3b-e114-45d2-8d0b-fe664b61a135 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:43.249632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.251784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:43.263478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:43.264470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.264889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.265330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] PATH_INFO: `/v3/projects/c11ea08128624c7496157a54fa2d06e2/users/987d0111ba434c9b855126c6d3bdecf9/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.302362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11ea08128624c7496157a54fa2d06e2, user_id=987d0111ba434c9b855126c6d3bdecf9, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:43.307798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95e15-ac8f-475a-8fc9-56e7fa3203d0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:43.340985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 860/1694] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:43 2022] PUT /identity/v3/projects/c11ea08128624c7496157a54fa2d06e2/users/987d0111ba434c9b855126c6d3bdecf9/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:43.353433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.354038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.354534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.437229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] MFA Rules not processed for user `987d0111ba434c9b855126c6d3bdecf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:43.438583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:43.530950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1175d-770f-44d3-a205-c283761b7372 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:43.610333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 861/1695] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:43.615036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.740227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:43.740858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.741137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.741413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.764127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:43.813015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174da64-5f22-4cc2-a139-e786886153ed None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:43.831640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:43.831865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:43.832407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:43.832682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:43.832964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:43.833698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:43.835870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:43.869925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:43.873594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:43.885314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 835/1696] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:43.887839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.890361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:43.924374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 862/1697] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:43 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:16:43.928442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:43.932944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:43.941382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441951d-a08f-4237-b376-4c3af96f00e3 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.093502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.094452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.094831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.095231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] PATH_INFO: `/v3/users/a9aeb232914c42d1af686c5491c5e3a7` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.096681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9aeb232914c42d1af686c5491c5e3a7)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.098772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.143862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958b873-fd59-4946-b5a8-8c60dbcb1c2b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.166268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.166923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.167278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.167512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] PATH_INFO: `/v3/projects/5e15eb4f92354f5fbd58ae574457b16a` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.170014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e15eb4f92354f5fbd58ae574457b16a)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.172586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.226164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9aeb232914c42d1af686c5491c5e3a7'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.255291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e15eb4f92354f5fbd58ae574457b16a', 'request_id': 'req-759d79e8-72dc-44f6-956f-791218f59d24'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.260051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9aeb232914c42d1af686c5491c5e3a7'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.264558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e15eb4f92354f5fbd58ae574457b16a', 'request_id': 'req-759d79e8-72dc-44f6-956f-791218f59d24'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.272066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e15eb4f92354f5fbd58ae574457b16a', 'request_id': 'req-759d79e8-72dc-44f6-956f-791218f59d24'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.277970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9aeb232914c42d1af686c5491c5e3a7'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.285758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] The token cache is being invalidate because project 5e15eb4f92354f5fbd58ae574457b16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:44.285758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.286309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.288465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 863/1698] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:43 2022] DELETE /identity/v3/projects/5e15eb4f92354f5fbd58ae574457b16a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:44.289570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:44.291886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.296578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9aeb232914c42d1af686c5491c5e3a7'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.297657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-720748c4-8a1d-46b2-b951-d6ea8b4abe27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9aeb232914c42d1af686c5491c5e3a7'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:44.313027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 836/1699] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:43 2022] DELETE /identity/v3/users/a9aeb232914c42d1af686c5491c5e3a7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:44.315721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.319044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.319430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.372168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:44.374519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.387397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d79e8-72dc-44f6-956f-791218f59d24 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.394298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:44.472753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.473456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.474150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.474504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.475257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.484099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a66b-7ecb-46f9-9691-f45b17be151e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.516190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:44.534347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 864/1700] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:44 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:44.537093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05957-628d-46bf-b79b-29b6710f38b5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.537387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05957-628d-46bf-b79b-29b6710f38b5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.539944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05957-628d-46bf-b79b-29b6710f38b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.552054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 837/1701] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:44.562957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:44.565191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.590667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c470bf5-25b6-43a2-aec4-75bac80a2896 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.609620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ade05957-628d-46bf-b79b-29b6710f38b5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:44.612853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ade05957-628d-46bf-b79b-29b6710f38b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.617245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.621775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.625265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.626819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.628835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.637402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.640101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 865/1702] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:44.644242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.644979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.647498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.694666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 838/1703] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:44.696043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:44.707172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.710719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:44.712359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:44.733026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 866/1704] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:44.734158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:44.772472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c022a86-1b29-415f-9b2d-f19165e836c7 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.787470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.788335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.791101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.792548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.798336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.804814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.856982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 867/1705] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:44.857872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:44.901944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958689f-5a2d-4a91-900c-1f5bfbbb069b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.933647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.935340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.935695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.935891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:44.949653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:44.952306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:44.960103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:44.975139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836a89-1ccf-4657-a600-265325f8282d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:44.985702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:44.987591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:44.988730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:44.990220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.003852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 868/1706] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:45.007800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.037908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd78c-6a7f-43af-9b38-843783c24696 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.043965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.049443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.062845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.063884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.064166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.064987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] PATH_INFO: `/v3/projects/7b20601c748c497190bc6453705a096b/users/658ac1a8c47d4ecf86080419db15b16c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.078346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 839/1707] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:45.080377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.099945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533fa9-b6f0-4df8-8b5c-b35b3505cc02 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.111673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.111966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b20601c748c497190bc6453705a096b, user_id=658ac1a8c47d4ecf86080419db15b16c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.113259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.115395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.115749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.116088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed5d86-38cf-4225-9287-5d7bc6e18cf5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.117314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.123593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.141782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 869/1708] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:45 2022] PUT /identity/v3/projects/7b20601c748c497190bc6453705a096b/users/658ac1a8c47d4ecf86080419db15b16c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:45.153973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.154470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.154890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.228499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 840/1709] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:45.229843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.233436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] MFA Rules not processed for user `658ac1a8c47d4ecf86080419db15b16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:45.237089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:45.390037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53698be4-e0a8-401a-a521-8918acee416d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.405596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.406316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.406689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.407059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.407925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.413055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.413284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 870/1710] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:45.415225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.442889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f118-592e-47f2-9b50-9a7d6a7cfe74 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.458339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.459544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.460639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.462064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.463872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.464816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 841/1711] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:45.467652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.471032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.490119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3146aa-f9bb-42f8-9bbf-e744a62f2930 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.510540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.511412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.512809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.513267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.514273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.516107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.546391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 842/1712] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:45.546564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 871/1713] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:45.547673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.548511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.554378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:45.579260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2693-6b25-4a52-866e-61895388b68e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.651343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e9d9c-ef3e-41e7-8dff-341dd03c5c7b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.658413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.659141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.659425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.659694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.660728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.662696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.684701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:45.697507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 872/1714] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:45.706061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.730798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94300d-37d9-4bbb-8289-474e6415fdd3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.734850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.736361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.737192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.738596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.739873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.744233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.744914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.745611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.746753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.749093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.751527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.759878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.784848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 843/1715] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:45.786032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.795746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 873/1716] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:45.801448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.816715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf92b-3257-4dec-b708-c74aafaa7613 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.817015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142154c8-eca8-44aa-a983-44b0bc3697d8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:45.823575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.825425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.825631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:45.825786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.826083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] PATH_INFO: `/v3/projects/c8907698c80e4c58964dd0aa2030cfe0/users/98086ac333a345cc8af151fb4e289759/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.827417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.827705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.829157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] PATH_INFO: `/v3/projects/2f15625bcced4be7ba65922f38ed9906/users/29326deadfa04291bd167d707240c3ad/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:45.846274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8907698c80e4c58964dd0aa2030cfe0, user_id=98086ac333a345cc8af151fb4e289759, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.852261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.869463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f15625bcced4be7ba65922f38ed9906, user_id=29326deadfa04291bd167d707240c3ad, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:45.881409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 874/1717] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:45 2022] PUT /identity/v3/projects/c8907698c80e4c58964dd0aa2030cfe0/users/98086ac333a345cc8af151fb4e289759/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:45.885283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:45.895772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5683-55bc-4644-b547-3ea28bb1c1e9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:45.920411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 844/1718] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:45 2022] PUT /identity/v3/projects/2f15625bcced4be7ba65922f38ed9906/users/29326deadfa04291bd167d707240c3ad/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:45.930734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:45.931607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:45.933344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.002048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] MFA Rules not processed for user `29326deadfa04291bd167d707240c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:46.003690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:46.097539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d754f-0d54-4154-9cec-288c076863a7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:46.225372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 845/1719] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:46.233656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:46.281703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:46.282332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.282619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.283194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.283904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:46.285648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:46.317238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 875/1720] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:46.318716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:46.326161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:46.334500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cc33b-1ed0-43a0-9f6f-ce3066e148a8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:46.354721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:46.355821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.356276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.356812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] PATH_INFO: `/v3/projects/c8907698c80e4c58964dd0aa2030cfe0/users/98086ac333a345cc8af151fb4e289759/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.359482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8907698c80e4c58964dd0aa2030cfe0, user_id=98086ac333a345cc8af151fb4e289759, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:46.368999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738277f-c233-4a10-b355-bcad316bca9c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:46.390353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d91cf-3477-4c6c-aba3-9473a04c4676 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:46.407293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 876/1721] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:46 2022] PUT /identity/v3/projects/c8907698c80e4c58964dd0aa2030cfe0/users/98086ac333a345cc8af151fb4e289759/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:46.408818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.409118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.409562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.446248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] MFA Rules not processed for user `98086ac333a345cc8af151fb4e289759`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:46.449842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:46.463050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:46.499679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:46.500041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.500672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.500672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.501487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:46.512392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:46.584752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 846/1722] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:46 2022] POST /identity/v3/projects => generated 377 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:46.585813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:46.648586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 877/1723] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:46.656886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:46.659487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:46.762375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b47b58-50c2-4130-952a-104fb7ed59a7 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:46.809662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509979c1-4b31-4e50-9d37-2833531daf15 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:46.867197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:46.869369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.870541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.872997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.875013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:46.883363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5a03a-1036-4932-8368-ea4555cbf677 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:46.916265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:46.922516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.923194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.923194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:46.984579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 847/1724] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:46 2022] POST /identity/v3/users => generated 295 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:46.988519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17436a-a443-420a-adfa-228e624e321c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:46.989026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17436a-a443-420a-adfa-228e624e321c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:46.989446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17436a-a443-420a-adfa-228e624e321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:47.076028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ba17436a-a443-420a-adfa-228e624e321c None None] MFA Rules not processed for user `6e92282873df4a6fa7511c6c4cdab140`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:47.078150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ba17436a-a443-420a-adfa-228e624e321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:47.242945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:47.287699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:47.292416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:47.332614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 878/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:16:47.337428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:47.368702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 848/1726] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:47.379979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17436a-a443-420a-adfa-228e624e321c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:47.381403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51799b-8813-48d6-b97d-e743782a1099 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:47.385348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ba17436a-a443-420a-adfa-228e624e321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:47.395849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:47.397431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:47.397757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:47.398033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:47.399838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:47.405043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:47.427181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 879/1727] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:47.437331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:47.465944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc70671-335c-415a-85e5-33927a933426 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:47.477761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:47.478458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:47.478738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:47.483485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] PATH_INFO: `/v3/projects/c79e58a1296c4256bc192216b77f184a/users/2ab35886feaa4c12809e9756a3d50911/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:47.552978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79e58a1296c4256bc192216b77f184a, user_id=2ab35886feaa4c12809e9756a3d50911, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:47.565524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497b9e-9819-4637-a9b2-e6da8c6bd76e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:47.631180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 880/1728] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:47 2022] PUT /identity/v3/projects/c79e58a1296c4256bc192216b77f184a/users/2ab35886feaa4c12809e9756a3d50911/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:47.631180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:47.631417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:47.632315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:47.632913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:47.684073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17436a-a443-420a-adfa-228e624e321c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:47.715881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] MFA Rules not processed for user `7acceb819010462cb3a887d9661e4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:47.717134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:47.878345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:47.879317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:47.880153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:47.880438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:47.985743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 881/1729] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:47.985743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.078428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.080174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.145907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2cfb0-3711-43ca-b848-47861e67b02c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:48.167461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:48.167461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.167461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.168640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.169383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.171372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.171568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 849/1730] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:48.173526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.183500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.189963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 882/1731] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:48.234702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.241953 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.263800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62363-3534-45b1-bb91-f581b5c0a229 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:48.275588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:48.278190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.279024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.279984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] PATH_INFO: `/v3/projects/02bcc9fdd18a47359d560cc9d35b1406` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.282799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bcc9fdd18a47359d560cc9d35b1406)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.288501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.289180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3022cbb-8d05-4e7b-804a-b8dfd2f8bd7f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:48.304554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:48.305197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.305484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.305815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.334795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.344018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d5df-5f8f-47f9-ad68-9c29bfb4a539 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.362456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bcc9fdd18a47359d560cc9d35b1406', 'request_id': 'req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:48.364295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 883/1732] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:48.365863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476f10-36ce-4134-86d6-9b838f157249 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.366152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476f10-36ce-4134-86d6-9b838f157249 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.366431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb476f10-36ce-4134-86d6-9b838f157249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.374298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bcc9fdd18a47359d560cc9d35b1406', 'request_id': 'req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:48.398195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bcc9fdd18a47359d560cc9d35b1406', 'request_id': 'req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:48.414172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] The token cache is being invalidate because project 02bcc9fdd18a47359d560cc9d35b1406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:48.425281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:48.431491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:48.438171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 850/1733] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:48 2022] DELETE /identity/v3/projects/02bcc9fdd18a47359d560cc9d35b1406 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:48.439249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.446302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.457272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bb476f10-36ce-4134-86d6-9b838f157249 None None] MFA Rules not processed for user `7918c9efb8504d2197556022eb9dffc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:48.458621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bb476f10-36ce-4134-86d6-9b838f157249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.479267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:48.493540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:48.593767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee59a-0951-45c3-882b-7ccdcb7cea16 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:48.604096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:48.604786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.606197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.606197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] PATH_INFO: `/v3/projects/c79e58a1296c4256bc192216b77f184a/users/2ab35886feaa4c12809e9756a3d50911/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.617126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79e58a1296c4256bc192216b77f184a, user_id=2ab35886feaa4c12809e9756a3d50911, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.617126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.645607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 851/1734] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:48 2022] PUT /identity/v3/projects/c79e58a1296c4256bc192216b77f184a/users/2ab35886feaa4c12809e9756a3d50911/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:48.646728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.656870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.682217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 884/1735] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:48.682217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07926-5bdf-4647-9b18-68fa557339c2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.682217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07926-5bdf-4647-9b18-68fa557339c2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.682217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07926-5bdf-4647-9b18-68fa557339c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.722763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-56f07926-5bdf-4647-9b18-68fa557339c2 None None] MFA Rules not processed for user `2ab35886feaa4c12809e9756a3d50911`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:48.724283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-56f07926-5bdf-4647-9b18-68fa557339c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.872504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 885/1736] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:48.878041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.878485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.878650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199452b-afe5-42d6-8a88-1c5aa506d085 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:48.878755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.900787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] MFA Rules not processed for user `7918c9efb8504d2197556022eb9dffc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:48.902546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:48.905022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:48.905549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:48.905876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:48.906199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] PATH_INFO: `/v3/users/0c382ca05f974be49fe707d061abf03a` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:48.907612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c382ca05f974be49fe707d061abf03a)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:48.909802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:48.978247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 886/1737] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:48.980003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:48.982177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.014947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c382ca05f974be49fe707d061abf03a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:49.046644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c382ca05f974be49fe707d061abf03a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:49.063530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c382ca05f974be49fe707d061abf03a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:49.080236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c382ca05f974be49fe707d061abf03a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:49.081009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c382ca05f974be49fe707d061abf03a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:49.095844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:49.100815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 852/1738] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:48 2022] DELETE /identity/v3/users/0c382ca05f974be49fe707d061abf03a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:49.100815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:49.103142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.149268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c0d1c-e3c6-41cd-bfc6-13c56c407e6c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:49.182073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:49.289186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9dbe7-e71e-44bd-9a78-f40346007064 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:49.305298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:49.305944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:49.306227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:49.306504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:49.311245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.324356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:49.326183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:49.326473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:49.326753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:49.333857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.477646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:49.486341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:49.505598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 887/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:49.506567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:49.511008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.514366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:49.516042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377724e-66f3-49e5-9b64-0773ddee2ec7 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:49.539848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 853/1740] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:49.543897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d457-d482-47ca-bb15-c22b826235b1 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:49.549334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:49.550397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:49.550862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:49.551225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:49.553467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.660687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:49.665336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:49.681729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 888/1741] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:49.694809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219de14-d53b-4f04-96e0-969ad2f45e86 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:49.695260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219de14-d53b-4f04-96e0-969ad2f45e86 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:49.695530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219de14-d53b-4f04-96e0-969ad2f45e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:49.759361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0219de14-d53b-4f04-96e0-969ad2f45e86 None None] MFA Rules not processed for user `1080f0e19dd84503af28318412466485`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:49.763384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0219de14-d53b-4f04-96e0-969ad2f45e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:49.920310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 854/1742] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:50.248849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:50.250302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:50.310561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:50.331362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2302-f0f8-43ca-815b-3ed88089497e service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:50.349705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:50.350462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.350863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.351301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] PATH_INFO: `/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.353149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a67f9458ac4dec9a895d1ae8da4d08)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:50.355114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:50.473920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a67f9458ac4dec9a895d1ae8da4d08', 'request_id': 'req-072718ad-0a59-40ed-8f2c-e92f0813880c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:50.487040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a67f9458ac4dec9a895d1ae8da4d08', 'request_id': 'req-072718ad-0a59-40ed-8f2c-e92f0813880c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:50.494078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a67f9458ac4dec9a895d1ae8da4d08', 'request_id': 'req-072718ad-0a59-40ed-8f2c-e92f0813880c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:50.509799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] The token cache is being invalidate because project b5a67f9458ac4dec9a895d1ae8da4d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:50.510104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:50.511945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-072718ad-0a59-40ed-8f2c-e92f0813880c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:50.516064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 889/1743] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:50 2022] DELETE /identity/v3/projects/b5a67f9458ac4dec9a895d1ae8da4d08 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:50.517920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261734-8804-4fd0-bdb3-987c47e558b3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.518342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261734-8804-4fd0-bdb3-987c47e558b3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.518622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261734-8804-4fd0-bdb3-987c47e558b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.541172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-78261734-8804-4fd0-bdb3-987c47e558b3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:50.542235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-78261734-8804-4fd0-bdb3-987c47e558b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:50.681138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 855/1744] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:50.683104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.684289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.684858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.753444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:50.754442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d04a8-1a9d-48eb-845b-01a63c5c9db4 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.754920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:50.755054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d04a8-1a9d-48eb-845b-01a63c5c9db4 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.755896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d04a8-1a9d-48eb-845b-01a63c5c9db4 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.757580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 856/1745] 10.222.0.30 () {54 vars in 912 bytes} [Tue Aug 30 16:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:16:50.763331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.763616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.763899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.780145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 890/1746] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:50.782743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:50.801635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e17f5-d4f3-42a9-8525-a863b12316ee None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:50.807415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:50.820023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:50.820665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.821487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.822432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.823406 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:16:50.823718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:50.826837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:50.840617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:50.841854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:50.873515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 891/1747] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:16:50.874838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:50.888745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24eb2-2462-441d-8335-f980386a9d7f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:50.895672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:50.896870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:50.897182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:50.897932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:50.898787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:50.901055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:50.967352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 857/1748] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:16:50.975110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:50.976734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 892/1749] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:50 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:50.977605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:50.984651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:50.994036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2633f-89ec-460f-b176-6996f1c3c659 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.101424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.102068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.102351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.102634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.118199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.120215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.132801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 858/1750] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:51.145106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4ec0f-6f53-43f6-aadb-657ed944f0c6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.153713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.154586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.155082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.155518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.156928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.159436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.191849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 893/1751] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:50 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:16:51.199247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:51.218810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8954f-18e7-4b81-a028-6dd1b1555c46 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.231051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.231691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.231977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.232403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.233067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.234823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.251608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 859/1752] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:51.252823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:51.265795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980042d9-476a-4e0a-81f3-efb04c8c69ea admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.271876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.272511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.272797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.273076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.273736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.275481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98213-063d-4148-854a-46167f4689cd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.292701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 894/1753] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:51.294505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:51.310958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599f79-e0a4-4299-ba31-38d5248eb0d9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.323431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.326532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.326866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.327176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] PATH_INFO: `/v3/projects/b37135fc6d5b4300b99db7948e4ef92c/users/827d9e0a719d4ef2b8ef27774f68ae03/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.354476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37135fc6d5b4300b99db7948e4ef92c, user_id=827d9e0a719d4ef2b8ef27774f68ae03, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.373449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c49999-60fa-4e39-a754-17e35e3996a3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.396461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 860/1754] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:51 2022] PUT /identity/v3/projects/b37135fc6d5b4300b99db7948e4ef92c/users/827d9e0a719d4ef2b8ef27774f68ae03/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:16:51.408837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.409129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.409410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.476572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:51.497029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] MFA Rules not processed for user `827d9e0a719d4ef2b8ef27774f68ae03`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:51.499435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:51.561563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5468-752f-4252-8425-d76295e5b288 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.562057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5468-752f-4252-8425-d76295e5b288 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.562507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5468-752f-4252-8425-d76295e5b288 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.564603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 861/1755] 10.222.0.30 () {54 vars in 912 bytes} [Tue Aug 30 16:16:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:16:51.579155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.580707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.581657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.673538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:51.675621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:51.810170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 895/1756] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:51.814216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:51.940473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaae2f-862f-4c07-8683-94fe88ddb3bd None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:51.947095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:51.947800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:51.948087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:51.948365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:51.949300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:51.951583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:51.957431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 862/1757] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:52.015880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.016168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 896/1758] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:16:51 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:16:52.034540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee9ef-d4e0-433d-985b-1b9ec4bc4116 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:52.071388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.073516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:52.117749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:52.336113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:52.340929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:52.341312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:52.341676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:52.342282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:52.360597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:52.398060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e3e3-c475-4c9d-900a-4f16bfb45198 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:52.409112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:52.410415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:52.410729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:52.411032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:52.442223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:52.443792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:52.475446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 863/1759] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:16:52 2022] POST /identity/v3/users => generated 300 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:16:52.479935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.502052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 897/1760] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:16:52.532962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07197-3496-4600-8b9e-7c61ce2a60fe admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:52.562972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:52.563631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:52.563941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:52.564218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:52.564870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:52.566513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:52.606359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.608235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:52.623161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 864/1761] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:52.628079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.650893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af35fc8-e88f-4cec-bdaf-eb5bc7f05113 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:52.667341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:52.669721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:52.670083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:52.670431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] PATH_INFO: `/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536/users/d55d5b21be4b40b696a7a9cc5845e793/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:52.697386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:52.721404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda30b1837c4f2b8f2add1bd81b8536, user_id=d55d5b21be4b40b696a7a9cc5845e793, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:52.749021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:52.796616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 865/1762] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:52 2022] PUT /identity/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536/users/d55d5b21be4b40b696a7a9cc5845e793/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:52.798279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fa0a-8e34-436b-a74a-7c08d23413d3 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:52.802881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:52.964048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:52.965490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:52.965873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:52.966244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:52.970624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:53.007097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:53.009068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:53.041130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 898/1763] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:16:53.126416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec5790-d80f-45a4-96e1-542785d3dba1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:53.145661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:53.147598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:53.149711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:53.150609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:53.158445 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:53.164768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c4bf9-8ab6-4e09-8997-bc5eea4eaf0f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:53.200931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 866/1764] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:16:53.205139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:53.223798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6747-6b47-49ab-b615-d21a8bb6f04f service placement] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:53.240598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:53.243534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:53.243789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:53.244068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] PATH_INFO: `/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536/users/d55d5b21be4b40b696a7a9cc5845e793/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:53.254214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda30b1837c4f2b8f2add1bd81b8536, user_id=d55d5b21be4b40b696a7a9cc5845e793, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:53.267190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:53.306913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 899/1765] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:16:53 2022] PUT /identity/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536/users/d55d5b21be4b40b696a7a9cc5845e793/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:53.319565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:53.319868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:53.320150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:53.381891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:53.384096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:53.453275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] MFA Rules not processed for user `d55d5b21be4b40b696a7a9cc5845e793`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:53.456644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:53.614442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3fd6d-e9d6-490a-be54-55019122cf8c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:53.628806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:53.629444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:53.629729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:53.630007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:53.639792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:53.646812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:53.661350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 867/1766] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:53.886444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:53.888784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:53.920398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6945ee-8a59-4f39-a375-597a05538131 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:53.941422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:53.950958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:53.953819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee9a35-37a0-47a0-8698-51ad9d49762f service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:53.955297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:53.960762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:53.964872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:53.968241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:53.996582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 900/1767] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:54.003618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:54.005225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612fa35-0a65-46a2-81a9-2effaa7f695a service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:54.057604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 868/1768] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:54.509981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:54.510351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:54.510707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:54.559032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] MFA Rules not processed for user `6e92282873df4a6fa7511c6c4cdab140`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:54.560591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:54.762936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 901/1769] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:54.811307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:54.811829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:54.812289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:54.985437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] MFA Rules not processed for user `7acceb819010462cb3a887d9661e4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:54.993956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:55.236414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 869/1770] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:55.564736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:55.748316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:55.777915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f6365-a9da-412e-80d6-c418a087a82c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:55.792577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:55.794683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:55.794831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192113-9acb-4e32-9467-402df29b0892 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:55.796624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:55.796975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:55.813114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:55.817079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:55.817905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:55.818325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:55.818951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] PATH_INFO: `/v3/users/827d9e0a719d4ef2b8ef27774f68ae03` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:55.820288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827d9e0a719d4ef2b8ef27774f68ae03)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:55.822645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:55.941923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827d9e0a719d4ef2b8ef27774f68ae03'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:55.972442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827d9e0a719d4ef2b8ef27774f68ae03'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:55.992903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827d9e0a719d4ef2b8ef27774f68ae03'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:55.993601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827d9e0a719d4ef2b8ef27774f68ae03'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:55.996780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:56.001688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475269-0ef7-4d45-8b05-458b4342672b service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:56.036252 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827d9e0a719d4ef2b8ef27774f68ae03'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:56.039240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 870/1771] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:56.053880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 902/1772] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:55 2022] DELETE /identity/v3/users/827d9e0a719d4ef2b8ef27774f68ae03 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:56.059531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb0c-39dd-4bd8-b116-f0a4c081f1d7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:56.059816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb0c-39dd-4bd8-b116-f0a4c081f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:56.060467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb0c-39dd-4bd8-b116-f0a4c081f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:56.101873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ee9dcb0c-39dd-4bd8-b116-f0a4c081f1d7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:56.104353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ee9dcb0c-39dd-4bd8-b116-f0a4c081f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:56.247641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 871/1773] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:56.258758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:56.261119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:56.386851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:56.474189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e071db-9faa-4122-a954-2ceb6e76a8c6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:56.484372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:56.485131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:56.485405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:56.487206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:56.540120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:56.541617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:56.568552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 903/1774] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:16:57.790764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:57.792349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:57.792830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:57.864742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:57.909087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:16:57.910383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:58.221276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 872/1775] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:16:58.526090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:58.528171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:58.846143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3637-ab2b-478b-b753-4cfa025f19b8 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:58.867853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:58.868509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:58.868792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:58.869069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:58.899898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:58.901729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:58.937766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 904/1776] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:59.295838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:59.297378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:16:59.334928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f815ef-fef9-49f9-ac72-f989a07414f3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:59.361389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:59.362508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:59.363051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:59.363561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] PATH_INFO: `/v3/projects/b37135fc6d5b4300b99db7948e4ef92c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:59.378650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37135fc6d5b4300b99db7948e4ef92c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:59.381948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:16:59.635957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37135fc6d5b4300b99db7948e4ef92c', 'request_id': 'req-621d1262-dde3-49a2-b894-74652398ebae'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:59.675128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37135fc6d5b4300b99db7948e4ef92c', 'request_id': 'req-621d1262-dde3-49a2-b894-74652398ebae'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:59.696491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37135fc6d5b4300b99db7948e4ef92c', 'request_id': 'req-621d1262-dde3-49a2-b894-74652398ebae'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:59.752155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] The token cache is being invalidate because project b37135fc6d5b4300b99db7948e4ef92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:16:59.752452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:59.754061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:16:59.760145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 873/1777] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:59 2022] DELETE /identity/v3/projects/b37135fc6d5b4300b99db7948e4ef92c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:16:59.766308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:16:59.792799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e847-5093-41b0-9758-feb011d64409 service swift] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:16:59.944763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:16:59.945672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:16:59.946274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:16:59.946703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] PATH_INFO: `/v3/users/d55d5b21be4b40b696a7a9cc5845e793` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:16:59.949810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55d5b21be4b40b696a7a9cc5845e793)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:16:59.955561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:00.073587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:00.100064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55d5b21be4b40b696a7a9cc5845e793'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:00.175392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55d5b21be4b40b696a7a9cc5845e793'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:00.202958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55d5b21be4b40b696a7a9cc5845e793'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:00.204395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55d5b21be4b40b696a7a9cc5845e793'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:00.298081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-31977639-8ee0-4c7c-a1a0-96ceec635a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55d5b21be4b40b696a7a9cc5845e793'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:00.340631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 905/1778] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:16:59 2022] DELETE /identity/v3/users/d55d5b21be4b40b696a7a9cc5845e793 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:00.565703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:00.568630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:00.638249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1262-dde3-49a2-b894-74652398ebae admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:00.939769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:00.943013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:00.943368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:00.943654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] PATH_INFO: `/v3/users/987d0111ba434c9b855126c6d3bdecf9` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:00.952836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987d0111ba434c9b855126c6d3bdecf9)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:00.965396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:01.112724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:01.179017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987d0111ba434c9b855126c6d3bdecf9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.235049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987d0111ba434c9b855126c6d3bdecf9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.256588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987d0111ba434c9b855126c6d3bdecf9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.271005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987d0111ba434c9b855126c6d3bdecf9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.271810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987d0111ba434c9b855126c6d3bdecf9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.288427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 874/1779] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:00 2022] DELETE /identity/v3/users/987d0111ba434c9b855126c6d3bdecf9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:01.299677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:01.301855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:01.302292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:01.375193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:01.379767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:01.663909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 906/1780] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:01.693367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:01.695611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:01.719226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:01.720902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:01.752903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520b97-f2f3-4a27-93ea-e12a22374ec2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:01.782937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:01.783937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:01.785250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:01.785536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] PATH_INFO: `/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:01.790593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bda30b1837c4f2b8f2add1bd81b8536)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:01.792942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:01.910413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427f0b-2522-49cd-8035-0d530cafa699 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:01.955895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bda30b1837c4f2b8f2add1bd81b8536', 'request_id': 'req-e1150180-c956-4db3-b7cf-aef0301dc5f6'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.974244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bda30b1837c4f2b8f2add1bd81b8536', 'request_id': 'req-e1150180-c956-4db3-b7cf-aef0301dc5f6'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:01.992310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bda30b1837c4f2b8f2add1bd81b8536', 'request_id': 'req-e1150180-c956-4db3-b7cf-aef0301dc5f6'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:02.029660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] The token cache is being invalidate because project 3bda30b1837c4f2b8f2add1bd81b8536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:02.030224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:02.031388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1150180-c956-4db3-b7cf-aef0301dc5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:02.033657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 907/1781] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:01 2022] DELETE /identity/v3/projects/3bda30b1837c4f2b8f2add1bd81b8536 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:02.040935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae035-99f6-4c0d-8adc-809070d817cb None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.041443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae035-99f6-4c0d-8adc-809070d817cb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.047477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae035-99f6-4c0d-8adc-809070d817cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.095596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:02.096505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.096595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.096820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.102464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f59ae035-99f6-4c0d-8adc-809070d817cb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:02.105796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:02.118415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f59ae035-99f6-4c0d-8adc-809070d817cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:02.251254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:02.352298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 908/1782] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:02.362616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.362905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.363427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.403425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:02.404663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:02.440901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 909/1783] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:02.441025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:02.441423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:02.442666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:02.457769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 875/1784] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:02.480615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16252e72-30d4-4f6c-8d57-8b073a940fe9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:02.499190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:02.501992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.502391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.503294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.506246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:02.506246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:02.514078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ccbb6-5086-47d6-ae02-e28f0bea9e7f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:02.573634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 910/1785] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:17:02.576070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:02.591499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d534-37fe-43c7-9221-9d988dc9ee6d service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:02.608027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:02.608852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.609455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.609810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.611668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:02.616504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:02.639266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:02.712912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:02.713344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:02.713858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:02.762021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 876/1786] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:02 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:02.768124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:02.804003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:02.815242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:03.034738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b908-2136-4a90-8803-1a529c0a41d9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.049551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.050302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.050695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.051103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.051879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.053951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.079323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 911/1787] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 30 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:03.127752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 877/1788] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:02 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:03.129872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:03.155900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:03.170529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:03.210552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce20d-3110-49f1-9e8e-18c87efaee60 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.220975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.221620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.222974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.223361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.227995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d18c6d-8320-4e09-82a4-79d8caffded5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.238382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.240831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.248328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.249150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.249847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.250378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.251282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.265223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 878/1789] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:03.269634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.276359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:03.299289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 912/1790] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:03.312052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:03.326110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:03.338598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd587-5e01-484f-af5f-715b6fd8fdd7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.362380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.363088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.363304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.363467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.371899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.373659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.375531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcf8ca-f2d2-45c6-b2b7-602b5b01d446 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.410105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.410743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.411047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.411345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.429683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 913/1791] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:03.433705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:03.447979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.449601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b8d0f-5246-4b8a-9c1a-e2b5c91e51d0 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.476929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0b745-c792-476e-8eb9-89957c742c3f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:03.480860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 879/1792] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:03.504395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:03.505087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.505641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.505928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] PATH_INFO: `/v3/projects/0bd5c1b3d74b4bd1a45bc64dd3d91897/users/2c07d1ae3e304167adfdc3c9f8a76e2e/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.574972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd5c1b3d74b4bd1a45bc64dd3d91897, user_id=2c07d1ae3e304167adfdc3c9f8a76e2e, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:03.581292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:03.662222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 914/1793] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:03 2022] PUT /identity/v3/projects/0bd5c1b3d74b4bd1a45bc64dd3d91897/users/2c07d1ae3e304167adfdc3c9f8a76e2e/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:03.672874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:03.673228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:03.673496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:03.792212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] MFA Rules not processed for user `2c07d1ae3e304167adfdc3c9f8a76e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:03.795688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:04.018219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 880/1794] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:04.022091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:04.242596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee347-4f2b-4150-980f-96a7224b5ba8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:04.257538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:04.258265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:04.258596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:04.258875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:04.259598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:04.264189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:04.354553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:04.355474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 915/1795] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:04 2022] POST /identity/v3/projects => generated 387 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:04.374777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c086a-7707-44c8-a1df-0eea6c130704 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:04.476017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:04.516323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:04.516323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:04.516630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:04.516760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:04.517463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:04.537357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:04.590589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 881/1796] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:04 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:04.595609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:04.629233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739508-4125-403c-8b21-1b68ec05ac61 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:04.642570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:04.643692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:04.644263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:04.645126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:04.646505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:04.650860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:04.658562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:04.692242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 916/1797] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:04.692488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:04.715238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebc8fa-406e-4232-bc14-f566c476adf6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:04.725214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:04.726557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:04.727304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:04.727950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] PATH_INFO: `/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d/users/1940c3c9e61f41f6962056f12e043034/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:04.765064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6891a7ea64c05b8dbb7f731292d9d, user_id=1940c3c9e61f41f6962056f12e043034, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:04.771021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:04.848337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 882/1798] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:04 2022] PUT /identity/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d/users/1940c3c9e61f41f6962056f12e043034/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:04.854530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:04.939027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731032c5-b80d-4fc2-b3be-0be7b3bb2d50 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:05.126892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:05.143110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:05.143893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:05.145058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:05.147748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:05.156220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30a42-5005-4002-8fc3-fd170cef730e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:05.176081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 917/1799] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:05.180553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:05.199067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230720f6-f569-4aeb-83bf-8fa0da0b7992 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:05.212963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:05.213649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:05.213983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:05.214354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] PATH_INFO: `/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d/users/1940c3c9e61f41f6962056f12e043034/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:05.216444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6891a7ea64c05b8dbb7f731292d9d, user_id=1940c3c9e61f41f6962056f12e043034, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:05.219129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:05.251008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 883/1800] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:05 2022] PUT /identity/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d/users/1940c3c9e61f41f6962056f12e043034/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:05.252817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:05.253147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:05.253388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:05.316699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] MFA Rules not processed for user `1940c3c9e61f41f6962056f12e043034`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:05.317949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:05.478714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 918/1801] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:05.682475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:05.684859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:05.932942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f473-088f-432f-a737-43c64f290ca2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:05.940252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:05.940899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:05.941192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:05.941483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:05.978771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:05.980832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:06.009708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 884/1802] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:06.222769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:06.224751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:06.411885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafbcd5-a544-4259-bdee-18b341d14997 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:06.434777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:06.435730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:06.436182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:06.439412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] PATH_INFO: `/v3/projects/c11ea08128624c7496157a54fa2d06e2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:06.441780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11ea08128624c7496157a54fa2d06e2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:06.453842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:06.523863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:06.587811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11ea08128624c7496157a54fa2d06e2', 'request_id': 'req-bcb3ea74-c40d-4107-badf-34db55be19e8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:06.609803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11ea08128624c7496157a54fa2d06e2', 'request_id': 'req-bcb3ea74-c40d-4107-badf-34db55be19e8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:06.622048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11ea08128624c7496157a54fa2d06e2', 'request_id': 'req-bcb3ea74-c40d-4107-badf-34db55be19e8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:06.642349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] The token cache is being invalidate because project c11ea08128624c7496157a54fa2d06e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:06.642710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:06.643472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-bcb3ea74-c40d-4107-badf-34db55be19e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:06.650396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 919/1803] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:06 2022] DELETE /identity/v3/projects/c11ea08128624c7496157a54fa2d06e2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:06.652580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:06.678267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982d9b-f7ce-480a-9000-6a49815d5473 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:06.938047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:06.940165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:06.940904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:06.941368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] PATH_INFO: `/v3/users/658ac1a8c47d4ecf86080419db15b16c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:06.953191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658ac1a8c47d4ecf86080419db15b16c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:06.956492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:07.103071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:07.140770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658ac1a8c47d4ecf86080419db15b16c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:07.194968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658ac1a8c47d4ecf86080419db15b16c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:07.230859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658ac1a8c47d4ecf86080419db15b16c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:07.255220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658ac1a8c47d4ecf86080419db15b16c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:07.257108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ab2f2706-9c1b-4f0a-8d88-f1e161f9bdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658ac1a8c47d4ecf86080419db15b16c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:07.278892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 885/1804] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:06 2022] DELETE /identity/v3/users/658ac1a8c47d4ecf86080419db15b16c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:07.484570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:07.485208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:07.485208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:07.486763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 920/1805] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:17:07.548246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5539801-bcb6-4e1e-8ce3-55c7d3512662 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:07.548985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5539801-bcb6-4e1e-8ce3-55c7d3512662 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:07.549574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5539801-bcb6-4e1e-8ce3-55c7d3512662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:07.595571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d5539801-bcb6-4e1e-8ce3-55c7d3512662 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:07.599624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d5539801-bcb6-4e1e-8ce3-55c7d3512662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:07.776392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:07.780960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:07.883980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 886/1806] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:08.057991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405eb80-4275-4200-b23b-2ece28d50ccd None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:08.085963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:08.086116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:08.086358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:08.087081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] PATH_INFO: `/v3/users/2c07d1ae3e304167adfdc3c9f8a76e2e` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:08.090805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c07d1ae3e304167adfdc3c9f8a76e2e)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:08.093438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:08.256593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c07d1ae3e304167adfdc3c9f8a76e2e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:08.290005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c07d1ae3e304167adfdc3c9f8a76e2e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:08.304988 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c07d1ae3e304167adfdc3c9f8a76e2e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:08.305854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c07d1ae3e304167adfdc3c9f8a76e2e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:08.342500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c07d1ae3e304167adfdc3c9f8a76e2e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:08.362688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 921/1807] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:07 2022] DELETE /identity/v3/users/2c07d1ae3e304167adfdc3c9f8a76e2e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:08.367047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596466ec-9029-4551-87ea-02f3659cdd6a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:08.367628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596466ec-9029-4551-87ea-02f3659cdd6a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:08.367628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596466ec-9029-4551-87ea-02f3659cdd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:08.405156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-596466ec-9029-4551-87ea-02f3659cdd6a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:08.408644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-596466ec-9029-4551-87ea-02f3659cdd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:08.589954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 887/1808] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:08.655386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:08.657753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:08.678840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3fd-4f54-4cc5-acad-c273f906e4bb None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:08.679489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3fd-4f54-4cc5-acad-c273f906e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:08.679867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3fd-4f54-4cc5-acad-c273f906e4bb None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:08.683703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 888/1809] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:17:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:17:08.736924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:08.750626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:08.751871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:08.752385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:08.808948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88430-3739-47af-ac8c-f923a4d5c207 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:08.816259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:08.816949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:08.817066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:08.817263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:08.817557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:08.818217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:08.848166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:08.849855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:08.869327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 922/1810] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:08.922776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:09.013005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 889/1811] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:09.061719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:09.063453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:09.111033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c0529-77c5-4eca-b1d6-bdebfb4e4d94 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:09.140356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:09.140993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:09.141278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:09.141558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:09.148319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:09.174248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:09.174248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:09.196402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:09.206431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:09.212844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13baad-a2c1-458e-9b54-a8788102510c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:09.242446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:09.243073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:09.243366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:09.247037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:09.248508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 923/1812] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:09.258187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:09.260318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:09.278027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 890/1813] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:09.531907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:09.534400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:09.570505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c08a6-a7b2-412b-86c1-9ff6c2b60a17 service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:09.588372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:09.592062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:09.592235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:09.592564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] PATH_INFO: `/v3/projects/7b20601c748c497190bc6453705a096b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:09.602720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b20601c748c497190bc6453705a096b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:09.608694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:09.799426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b20601c748c497190bc6453705a096b', 'request_id': 'req-4d3ede97-716c-4abc-9620-24e486b099ae'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:09.815583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b20601c748c497190bc6453705a096b', 'request_id': 'req-4d3ede97-716c-4abc-9620-24e486b099ae'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:09.829934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b20601c748c497190bc6453705a096b', 'request_id': 'req-4d3ede97-716c-4abc-9620-24e486b099ae'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:09.867606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] The token cache is being invalidate because project 7b20601c748c497190bc6453705a096b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:09.867972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:09.868732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:09.882503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 924/1814] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:09 2022] DELETE /identity/v3/projects/7b20601c748c497190bc6453705a096b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:09.883436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:09.909642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b120daa-22f5-4458-b3b6-93ea63b1c935 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:10.069984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:10.071406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:10.071836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:10.072308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] PATH_INFO: `/v3/users/98086ac333a345cc8af151fb4e289759` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:10.075562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98086ac333a345cc8af151fb4e289759)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:10.081911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:10.206309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98086ac333a345cc8af151fb4e289759'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.252447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98086ac333a345cc8af151fb4e289759'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.289268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98086ac333a345cc8af151fb4e289759'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.307213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98086ac333a345cc8af151fb4e289759'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.308717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98086ac333a345cc8af151fb4e289759'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.331695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 891/1815] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:09 2022] DELETE /identity/v3/users/98086ac333a345cc8af151fb4e289759 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:10.462172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:10.463776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:10.501708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ede97-716c-4abc-9620-24e486b099ae admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:10.566111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:10.567755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:10.684113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:10.698251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:10.699285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:10.701073 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:10.702899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] PATH_INFO: `/v3/users/959595d95fc3443088b52c938aa4948c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:10.705510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959595d95fc3443088b52c938aa4948c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:10.711595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:10.723068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fcd4-e7da-40c1-858b-871dd6f2c3d9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:10.730617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:10.731733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:10.732021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:10.732402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] PATH_INFO: `/v3/projects/0bd5c1b3d74b4bd1a45bc64dd3d91897` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:10.733795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd5c1b3d74b4bd1a45bc64dd3d91897)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:10.736129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:10.832025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:10.840326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959595d95fc3443088b52c938aa4948c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.847563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd5c1b3d74b4bd1a45bc64dd3d91897', 'request_id': 'req-a1273c68-0b11-4469-9c89-d4d33d4a14f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.859989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd5c1b3d74b4bd1a45bc64dd3d91897', 'request_id': 'req-a1273c68-0b11-4469-9c89-d4d33d4a14f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.874532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959595d95fc3443088b52c938aa4948c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.880570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd5c1b3d74b4bd1a45bc64dd3d91897', 'request_id': 'req-a1273c68-0b11-4469-9c89-d4d33d4a14f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.888543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959595d95fc3443088b52c938aa4948c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.890226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959595d95fc3443088b52c938aa4948c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.915826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] The token cache is being invalidate because project 0bd5c1b3d74b4bd1a45bc64dd3d91897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:10.916422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.919132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.923696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 892/1816] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:10 2022] DELETE /identity/v3/projects/0bd5c1b3d74b4bd1a45bc64dd3d91897 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:10.924963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:10.927465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:10.938411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2818ae5f-d2e3-4d6c-9546-ca129b193e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959595d95fc3443088b52c938aa4948c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:10.962037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 925/1817] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:10 2022] DELETE /identity/v3/users/959595d95fc3443088b52c938aa4948c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:10.965228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:10.966013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:10.966399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:11.067240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273c68-0b11-4469-9c89-d4d33d4a14f8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:11.078869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:11.081497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:11.194695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:11.196135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:11.196794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:11.197352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] PATH_INFO: `/v3/users/1940c3c9e61f41f6962056f12e043034` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:11.199872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1940c3c9e61f41f6962056f12e043034)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:11.205064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:11.256757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:11.287674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 926/1818] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:11.313918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1940c3c9e61f41f6962056f12e043034'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:11.333855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1940c3c9e61f41f6962056f12e043034'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:11.342258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1940c3c9e61f41f6962056f12e043034'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:11.356079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1940c3c9e61f41f6962056f12e043034'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:11.356860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1940c3c9e61f41f6962056f12e043034'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:11.369424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:11.369929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 893/1819] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:10 2022] DELETE /identity/v3/users/1940c3c9e61f41f6962056f12e043034 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:11.372424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:11.505961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2571-f00f-40c5-878c-6d47dea7e2fa None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:11.648588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:11.649561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:11.650012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:11.650444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:11.661270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:11.776787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:11.848510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:11.859469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:11.873296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 927/1820] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:12.249847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.251597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.264593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.266055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.270181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29cb50-788d-464f-92d4-dae29e19631e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.279599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2836b6-262e-4756-b7ed-152f3451034e service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.285411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.286287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.286861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.287177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] PATH_INFO: `/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.288987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab6891a7ea64c05b8dbb7f731292d9d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.291027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.310562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.312475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.313436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.314629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] PATH_INFO: `/v3/projects/c8907698c80e4c58964dd0aa2030cfe0` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.321878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8907698c80e4c58964dd0aa2030cfe0)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.328413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.359669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab6891a7ea64c05b8dbb7f731292d9d', 'request_id': 'req-49b472a4-a3dc-43dd-ac25-5b656ad98b48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.371037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab6891a7ea64c05b8dbb7f731292d9d', 'request_id': 'req-49b472a4-a3dc-43dd-ac25-5b656ad98b48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.383829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab6891a7ea64c05b8dbb7f731292d9d', 'request_id': 'req-49b472a4-a3dc-43dd-ac25-5b656ad98b48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.402207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] The token cache is being invalidate because project 2ab6891a7ea64c05b8dbb7f731292d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:12.405024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.406616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.410664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 928/1821] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:12 2022] DELETE /identity/v3/projects/2ab6891a7ea64c05b8dbb7f731292d9d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:12.411724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.417150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.427765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8907698c80e4c58964dd0aa2030cfe0', 'request_id': 'req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.443497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8907698c80e4c58964dd0aa2030cfe0', 'request_id': 'req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.452867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8907698c80e4c58964dd0aa2030cfe0', 'request_id': 'req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.471556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] The token cache is being invalidate because project c8907698c80e4c58964dd0aa2030cfe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:12.471865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.472579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d5a3f820-d243-45ed-a6a9-acbe4a6c9ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.482566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 894/1822] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:12 2022] DELETE /identity/v3/projects/c8907698c80e4c58964dd0aa2030cfe0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:12.485129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b753-e0d8-435d-8c7a-55d0beaa219b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.485524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b753-e0d8-435d-8c7a-55d0beaa219b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.486305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b753-e0d8-435d-8c7a-55d0beaa219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.513946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-af60b753-e0d8-435d-8c7a-55d0beaa219b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:12.515642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-af60b753-e0d8-435d-8c7a-55d0beaa219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.562498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b472a4-a3dc-43dd-ac25-5b656ad98b48 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.596503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 895/1823] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:12.597942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.598273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.598506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.619748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:12.620279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:12.621472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.629893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.630250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 896/1824] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:12.631205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.636024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.636309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.636674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] PATH_INFO: `/v3/projects/3040209e48904acdb2dee0fa4152c48d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.638372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.639729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3040209e48904acdb2dee0fa4152c48d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.641777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.650518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516be22-2c3d-4dcc-99ad-0bb92708ee89 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.656328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.657059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.657346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.657625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] PATH_INFO: `/v3/users/29326deadfa04291bd167d707240c3ad` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.658813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29326deadfa04291bd167d707240c3ad)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.660776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.675699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:12.701340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3040209e48904acdb2dee0fa4152c48d', 'request_id': 'req-69561ec4-d078-420f-9f25-a45e1a4e4b04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.710155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3040209e48904acdb2dee0fa4152c48d', 'request_id': 'req-69561ec4-d078-420f-9f25-a45e1a4e4b04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.718072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3040209e48904acdb2dee0fa4152c48d', 'request_id': 'req-69561ec4-d078-420f-9f25-a45e1a4e4b04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.719801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29326deadfa04291bd167d707240c3ad'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.730193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] The token cache is being invalidate because project 3040209e48904acdb2dee0fa4152c48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:12.730593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.731413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69561ec4-d078-420f-9f25-a45e1a4e4b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.732969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29326deadfa04291bd167d707240c3ad'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.733387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 929/1825] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:12 2022] DELETE /identity/v3/projects/3040209e48904acdb2dee0fa4152c48d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:12.734479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.734859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.735267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.746688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29326deadfa04291bd167d707240c3ad'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.756548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:12.756705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29326deadfa04291bd167d707240c3ad'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.757389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6e370759-d8f1-4382-84ea-7c4dfe76a211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29326deadfa04291bd167d707240c3ad'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.758134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.777079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 897/1826] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:12 2022] DELETE /identity/v3/users/29326deadfa04291bd167d707240c3ad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:12.778551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72fbb-225f-4ff6-a029-2d53c8ae3ef5 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.779022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72fbb-225f-4ff6-a029-2d53c8ae3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.779303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72fbb-225f-4ff6-a029-2d53c8ae3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.799776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-63e72fbb-225f-4ff6-a029-2d53c8ae3ef5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:12.801058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-63e72fbb-225f-4ff6-a029-2d53c8ae3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.823621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 930/1827] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:12.824473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.825745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.837389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e831a3-2a74-434b-b0db-a5a4a1492fe5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.863296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 898/1828] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:12.864544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.864830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.865107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.886925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:12.888088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.896144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 899/1829] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:12.896746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.905551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.906183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.906459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.906730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] PATH_INFO: `/v3/users/cd71a41d24c740aab5106d8a7780ba6a` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.907074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0139b6-fe19-4076-9285-43c139b6daae None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.907925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd71a41d24c740aab5106d8a7780ba6a)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.909840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.912059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.912660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.912944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.913251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.913900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:12.914207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.915828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.928513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 900/1830] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:12.929241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.939710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1c20-0fe8-4257-b936-f5d90bc5eb45 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:12.944780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:12.945415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:12.945600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:12.945981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:12.946347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:12.947231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:12.947516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:12.949674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:12.961580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd71a41d24c740aab5106d8a7780ba6a'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.962778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 901/1831] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:12.963619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:12.965779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:12.973749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd71a41d24c740aab5106d8a7780ba6a'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.982148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd71a41d24c740aab5106d8a7780ba6a'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.982850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd71a41d24c740aab5106d8a7780ba6a'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:12.996824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd71a41d24c740aab5106d8a7780ba6a'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.003620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 931/1832] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:12 2022] DELETE /identity/v3/users/cd71a41d24c740aab5106d8a7780ba6a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:13.004702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.006051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.041593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422934d-110b-44d4-9dc2-ea2c6bea71bc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.053564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:13.109690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.110187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.111036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.111318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.114620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.115435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dca24-b254-456f-bbd6-45a785c6236f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.120843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.121832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.122184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.122542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.123302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.125966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.135610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.137727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.148933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 902/1833] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:13.149883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.151985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.166335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582844-937d-44df-ad2f-390faecd8270 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.166821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 932/1834] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:13.170681 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.262948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.263761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.264556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.264851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.265525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.268014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.269215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956d75-9436-47fd-b0ce-3995615ac335 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.275608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.277755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.278175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.278528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.279790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.282800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.313985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 903/1835] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:13.322160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 933/1836] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:13.322762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.323856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.339807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02d35-6255-4a56-9865-72346a9863f8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.366099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:13.422107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.422909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.423201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.423548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.424805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.426527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.427343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26024-4e6a-42c6-a327-9826809e9390 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.436531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.437311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.441881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.441881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.442104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 934/1837] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:13.442204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.443536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.444201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.460166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3adcb-c9ed-45b1-9e69-78a845b83c65 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.466444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.467258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.467632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.471486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.472047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.473992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.480240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 904/1838] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:13.481227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.484587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.495040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 935/1839] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:13.497009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.504503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52e9f-39b3-4266-a796-aff869ebcdd5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.508807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcacfe-fc93-4e5a-95b9-f3862537cca9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.509864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.511212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.511751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.512304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] PATH_INFO: `/v3/projects/1c8ef22ff95b473b9d5e653494acc52f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.513568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8ef22ff95b473b9d5e653494acc52f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.515802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.516105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.516891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.517425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.517846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.518761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.520736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.536409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 936/1840] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:13.537824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.553491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffaf1-0a56-4f0e-83ce-1cc8b6378488 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.559576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.560297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.560633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.561138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] PATH_INFO: `/v3/projects/90454b9a5de04c6790eda77d39c2edfe/users/b8a866bebbee4ce19937f2852efaf1f1/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.561448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:13.583216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=90454b9a5de04c6790eda77d39c2edfe, user_id=b8a866bebbee4ce19937f2852efaf1f1, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.586269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.592077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8ef22ff95b473b9d5e653494acc52f', 'request_id': 'req-4ef65a11-da4b-4a88-9f78-d5f13909fe11'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.602432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8ef22ff95b473b9d5e653494acc52f', 'request_id': 'req-4ef65a11-da4b-4a88-9f78-d5f13909fe11'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.610443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8ef22ff95b473b9d5e653494acc52f', 'request_id': 'req-4ef65a11-da4b-4a88-9f78-d5f13909fe11'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.611056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 937/1841] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:13 2022] PUT /identity/v3/projects/90454b9a5de04c6790eda77d39c2edfe/users/b8a866bebbee4ce19937f2852efaf1f1/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:13.612076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.648475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] The token cache is being invalidate because project 1c8ef22ff95b473b9d5e653494acc52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:13.648747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.649772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4ef65a11-da4b-4a88-9f78-d5f13909fe11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.652433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 905/1842] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:13 2022] DELETE /identity/v3/projects/1c8ef22ff95b473b9d5e653494acc52f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:13.654047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe84c-46af-489b-acd1-0c0460409add None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.654488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe84c-46af-489b-acd1-0c0460409add None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.655171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe84c-46af-489b-acd1-0c0460409add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.712098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-decbe84c-46af-489b-acd1-0c0460409add None None] MFA Rules not processed for user `b8a866bebbee4ce19937f2852efaf1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:13.713393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-decbe84c-46af-489b-acd1-0c0460409add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.715543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf36e-a724-4c4c-872f-a4190701e1bb admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.722018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.722630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.722912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.723220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.724044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.725784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d02f75-d49d-4ccf-a294-477ee41ded43 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.747735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 938/1843] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:13.747735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.747735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.747735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.774446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:13.775692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.784933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 906/1844] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:13.785687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe84c-46af-489b-acd1-0c0460409add None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.787068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-decbe84c-46af-489b-acd1-0c0460409add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.794661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 939/1845] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:13.802516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.804867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.807195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe84c-46af-489b-acd1-0c0460409add None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.812824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.813434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.813717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.814082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] PATH_INFO: `/v3/projects/2f15625bcced4be7ba65922f38ed9906` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.815198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f15625bcced4be7ba65922f38ed9906)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.817103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.820355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681bad-66a9-410c-b4bc-ab4dcd8e503d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.826757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:13.827670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.828239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.828529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] PATH_INFO: `/v3/projects/aa3e3c2746f7462fbe231c3be57195af/users/ac3314fd8c3f4068a5eacf5161202324/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.848705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3e3c2746f7462fbe231c3be57195af, user_id=ac3314fd8c3f4068a5eacf5161202324, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:13.851479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:13.870044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 940/1846] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:13 2022] PUT /identity/v3/projects/aa3e3c2746f7462fbe231c3be57195af/users/ac3314fd8c3f4068a5eacf5161202324/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:13.870917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:13.873582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.893685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f15625bcced4be7ba65922f38ed9906', 'request_id': 'req-612fa190-41c7-4120-b070-5341dce8d8c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.903111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f15625bcced4be7ba65922f38ed9906', 'request_id': 'req-612fa190-41c7-4120-b070-5341dce8d8c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.909860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f15625bcced4be7ba65922f38ed9906', 'request_id': 'req-612fa190-41c7-4120-b070-5341dce8d8c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.924633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] The token cache is being invalidate because project 2f15625bcced4be7ba65922f38ed9906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:13.924919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.925675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-612fa190-41c7-4120-b070-5341dce8d8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:13.927309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 907/1847] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:13 2022] DELETE /identity/v3/projects/2f15625bcced4be7ba65922f38ed9906 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:13.928607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce581-08a2-4219-8f91-f041fe00f04f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:13.928894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce581-08a2-4219-8f91-f041fe00f04f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:13.929380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce581-08a2-4219-8f91-f041fe00f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:13.932952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:13.950848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-75bce581-08a2-4219-8f91-f041fe00f04f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:13.952393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-75bce581-08a2-4219-8f91-f041fe00f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:13.980069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f9db-9f52-4703-8a01-b66ac4c136d8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:13.981668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:14.023819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 908/1848] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:14.029510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.029828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.030114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.031251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.031931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.032306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.032647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.034495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.058797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] MFA Rules not processed for user `ac3314fd8c3f4068a5eacf5161202324`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:14.060323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.110647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.112809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.143441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 941/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:14.144185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.146385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.153602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 909/1850] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:14.154416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.181989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948871b-bc0c-407b-9ba9-1738a2058676 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.182833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994858f9-17df-4489-b978-bcc31bceba4d service glance] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.187394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.188181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.188324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.188508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.188787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.189047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.189335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.189457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:14.189615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] PATH_INFO: `/v3/users/2ab35886feaa4c12809e9756a3d50911` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.189780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.190781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab35886feaa4c12809e9756a3d50911)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.191457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.193272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.213690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 910/1851] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:14.214866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.219817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.240594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f568-5980-41de-a1f3-07070171ed10 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.247192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.247858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.248157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.248462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.249098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.251146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.297150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 911/1852] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:14 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:14.298055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.304059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab35886feaa4c12809e9756a3d50911'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:14.313786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab35886feaa4c12809e9756a3d50911'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:14.324596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab35886feaa4c12809e9756a3d50911'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:14.325964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab35886feaa4c12809e9756a3d50911'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:14.342019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab35886feaa4c12809e9756a3d50911'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:14.345005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:14.353946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 942/1853] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:14 2022] DELETE /identity/v3/users/2ab35886feaa4c12809e9756a3d50911 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:14.353946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.366147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.403004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1aed-af62-4a70-8751-ad139720aaed admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.483106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e33fa-53bf-40dd-b8de-e40f6f28e877 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.489782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.490412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.490844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.491271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.492129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.494311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:14.495580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.532564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 943/1854] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:14 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:14.536390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.550578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f22be8-967c-4abe-85bd-315daf4efa05 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.556290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.557039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.557327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.558290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.559081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.559248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.560074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.560772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.560926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.561326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.561904 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.564106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.588788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 944/1855] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:14.590416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.595696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 912/1856] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:14 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:14.602408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.605828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0a39-4ce8-4c98-aed5-a3c7a027900b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.605991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.704926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.705661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.705934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.706208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] PATH_INFO: `/v3/projects/fdd6c87954ef48229e63ee8992e5859e/users/90144673f6e64e66a8fd78f47adb722c/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.723900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd6c87954ef48229e63ee8992e5859e, user_id=90144673f6e64e66a8fd78f47adb722c, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.727239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.743851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a6e3-f749-4612-b8a1-ae5c11af4453 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.747622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 945/1857] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:14 2022] PUT /identity/v3/projects/fdd6c87954ef48229e63ee8992e5859e/users/90144673f6e64e66a8fd78f47adb722c/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:14.749189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.908871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1536d-3492-4883-a5ce-0ee0d86a4e32 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.914424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.915062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.915345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.915616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.916262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.919916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.922960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:14.938852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 946/1858] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:14.940039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:14.942089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:14.956744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c83b4-b1f9-4a62-b607-705f82bba3a5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:14.961713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.962359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.962659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.962933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.964364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.966746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:14.967393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:14.967669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:14.967951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:14.969023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] PATH_INFO: `/v3/projects/c79e58a1296c4256bc192216b77f184a` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:14.969582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79e58a1296c4256bc192216b77f184a)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:14.971887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.004373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 913/1859] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:14 2022] POST /identity/v3/users => generated 287 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:15.005487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.016817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a05561-e44d-43ec-bfd0-08cc7820f153 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.022041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.022809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.023133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.023413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] PATH_INFO: `/v3/projects/fdd6c87954ef48229e63ee8992e5859e/users/90144673f6e64e66a8fd78f47adb722c/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.025571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd6c87954ef48229e63ee8992e5859e, user_id=90144673f6e64e66a8fd78f47adb722c, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.028858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.040333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 914/1860] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:15 2022] PUT /identity/v3/projects/fdd6c87954ef48229e63ee8992e5859e/users/90144673f6e64e66a8fd78f47adb722c/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:15.041110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79e58a1296c4256bc192216b77f184a', 'request_id': 'req-19e494f6-daa8-45db-acae-9cf8c3096135'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:15.052320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.059121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79e58a1296c4256bc192216b77f184a', 'request_id': 'req-19e494f6-daa8-45db-acae-9cf8c3096135'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:15.076040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79e58a1296c4256bc192216b77f184a', 'request_id': 'req-19e494f6-daa8-45db-acae-9cf8c3096135'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:15.092176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] The token cache is being invalidate because project c79e58a1296c4256bc192216b77f184a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:15.092784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:15.093529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-19e494f6-daa8-45db-acae-9cf8c3096135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:15.095301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 947/1861] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:14 2022] DELETE /identity/v3/projects/c79e58a1296c4256bc192216b77f184a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:15.096627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab24d-2d80-4f51-9ab7-3604469895c8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.096978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab24d-2d80-4f51-9ab7-3604469895c8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.097329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab24d-2d80-4f51-9ab7-3604469895c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.115159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:15.138285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d7bab24d-2d80-4f51-9ab7-3604469895c8 None None] MFA Rules not processed for user `90144673f6e64e66a8fd78f47adb722c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:15.139659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d7bab24d-2d80-4f51-9ab7-3604469895c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.159403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee951ba-ff6f-4cae-a4fa-1ab16348bb1d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.168025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.169338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.169690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.170036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.171394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.173701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c546-db9b-4136-a458-550c700d8aab admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.188734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 915/1862] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:15.190025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.190391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.190736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.215644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:15.216848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.225489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 916/1863] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:15.226291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.227565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.228798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 948/1864] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:15.233220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.233517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.233821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.244466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adac697-a38a-438d-af54-ecc2abf7428d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.249877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.250604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.250974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.251341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.252063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.253764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.254855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:15.256110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.267025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 949/1865] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:15.267228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 917/1866] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:15.269915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.270593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.271629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.286593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb250b37-3a26-4fed-81dc-f5f2237df36c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.294821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.295670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.295969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.296335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.297261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:15.297827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.299407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.318712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 918/1867] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:15.318712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.326257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd672dc-9ebd-4cb7-97e9-52daabab1378 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.332654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.332654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.332654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.332981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] PATH_INFO: `/v3/projects/7ba04fda5aae44d090c80135133fe4d7/users/074258ed3f494f1e9265346b58997c18/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.339096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7375d9-7e0c-4cc6-97ed-91ea1608a94b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.343699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.344321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.344604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.344882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.349780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba04fda5aae44d090c80135133fe4d7, user_id=074258ed3f494f1e9265346b58997c18, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.352912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b29e7-a854-4763-b322-b60198c4a77c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.355029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.356349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.367433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 950/1868] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:15.368328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.368871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 919/1869] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:15 2022] PUT /identity/v3/projects/7ba04fda5aae44d090c80135133fe4d7/users/074258ed3f494f1e9265346b58997c18/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:15.373906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:15.379787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.380075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.380180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4683-7830-4730-8693-07522a5be128 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.380473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.415823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] MFA Rules not processed for user `074258ed3f494f1e9265346b58997c18`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:15.417835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.459736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.460360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.460646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.460926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.461627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.464376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.509316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 920/1870] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:15.515313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.526273 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 951/1871] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:15.527410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.612924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e9d75-35fb-4815-838a-a6d2ea0d86a0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.649034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16850af-1a25-4657-aca9-e8b66955b4b8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.656188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:15.660862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.661660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.662049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.662566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.663393 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.667802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.699025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.699824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.700077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.700605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.703350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:15.715123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 952/1872] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:15.721379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.865114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256020-7ff7-4705-8f7b-a29b6bec53cb admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.870652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.872097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.872490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.872796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.877341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.880937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.889018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.889925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.906915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 921/1873] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:15.909739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.929867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 953/1874] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:15.933646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.940191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc0676-3990-4ced-9d6c-42d44fcbe36e service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.944598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:15.954319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310b3a-f0dd-47b4-a821-206568be9bb3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:15.956502 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.957136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.957416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.957689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.959343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.963027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.967572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:15.968515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:15.969005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:15.969512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:15.970446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:15.972484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:15.986030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 954/1875] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:15.990383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:15.994036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 922/1876] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:15 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:15.998907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.006497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f1441-0205-40ff-b460-aea471ff1cc7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.012618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.013359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.013958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.014106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.014358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f30a-52d2-4130-bc4b-6f29d75ac9a0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.015027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.017236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.021740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.022612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.023385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.024429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.025466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.028257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.035433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 955/1877] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:16.036423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.043386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 923/1878] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:16.047830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.048148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e110be-88e9-4ebf-8c99-4ef6b3eae6a0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.057345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.058168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.058520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.058871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] PATH_INFO: `/v3/projects/ef420f210b364a99877da2906f77486c/users/492a1eed84704edcb1669b269b25dbbb/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.064677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaff52-0d76-4ba0-90bd-3e78788ca99e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.078210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.078890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.079205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.079487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] PATH_INFO: `/v3/projects/7fb441e380764931a33a27e04c87d538/users/7e50cd10f27c473a93e37f816090604e/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.083680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef420f210b364a99877da2906f77486c, user_id=492a1eed84704edcb1669b269b25dbbb, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.086487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd61f4-cd0f-470b-8cbc-420dc9a85155 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.109830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb441e380764931a33a27e04c87d538, user_id=7e50cd10f27c473a93e37f816090604e, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.114325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.125446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 956/1879] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:16 2022] PUT /identity/v3/projects/ef420f210b364a99877da2906f77486c/users/492a1eed84704edcb1669b269b25dbbb/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:16.127221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.127517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.127798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.152496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 924/1880] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:16 2022] PUT /identity/v3/projects/7fb441e380764931a33a27e04c87d538/users/7e50cd10f27c473a93e37f816090604e/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:16.156293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.179431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] MFA Rules not processed for user `492a1eed84704edcb1669b269b25dbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:16.182130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:16.328422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 957/1881] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:16.332808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.338246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbf013-0088-4e46-86ee-1ed5ec40fcb1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.350188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.351530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.351810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.352081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.352738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.354378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.361563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12543a0-030d-402a-85e5-22124d046fb8 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.375090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.375920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.375920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.375920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.378760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.385240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 925/1882] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:16.386628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.390224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.409024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3e52-cc8d-4a03-a656-e1b1c7c9cf27 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.419056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.419921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.420577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.422683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] PATH_INFO: `/v3/projects/7fb441e380764931a33a27e04c87d538/users/7e50cd10f27c473a93e37f816090604e/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.437994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb441e380764931a33a27e04c87d538, user_id=7e50cd10f27c473a93e37f816090604e, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.440810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7da467-4c30-4129-a36e-500d66df9685 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.467105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 926/1883] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:16 2022] PUT /identity/v3/projects/7fb441e380764931a33a27e04c87d538/users/7e50cd10f27c473a93e37f816090604e/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:16.468705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.469886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 958/1884] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:16 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:16.470111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.470634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.476855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.538336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:16.567771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] MFA Rules not processed for user `7e50cd10f27c473a93e37f816090604e`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:16.569923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:16.613875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69bf8-3c89-446e-89ed-50b24a1f1ed3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.623678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.624390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.624675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.625005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.626277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.628943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.672971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 959/1885] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:16 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:16.674599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.703349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8c77-ccfd-4f4f-b7bc-77335aaa5a5c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.718476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.719336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.719718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.720094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.720852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.722848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.740107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 927/1886] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:16.748669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.759848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 960/1887] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:16.763819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.783170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:16.802824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9248-ba37-41e8-9eaf-c323648b3095 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.818780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.819568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.819915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.822102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] PATH_INFO: `/v3/projects/d87ecdc7728d4288a65a879f161cb9ff/users/a3be3a6eb47343c2bf1ad6a09a635eca/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:16.851628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87ecdc7728d4288a65a879f161cb9ff, user_id=a3be3a6eb47343c2bf1ad6a09a635eca, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:16.855023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:16.872675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462393f6-3189-484e-a3a6-327f0a0b8a9e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:16.880983 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 961/1888] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:16 2022] PUT /identity/v3/projects/d87ecdc7728d4288a65a879f161cb9ff/users/a3be3a6eb47343c2bf1ad6a09a635eca/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:16.884723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:16.979523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:16.980347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:16.980861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:16.981207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.016176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb09-21e7-4aed-b829-f9fbd52c21df admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:17.022229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:17.023512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.023512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.023693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.024493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.029677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.054092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 962/1889] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:17.058593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.068483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.070073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423e65-a786-4466-9fd9-882809620274 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.070795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf4ff-6e02-46be-9fc4-49d77737eb23 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:17.076195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:17.076481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:17.077409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.078021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.078235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] PATH_INFO: `/v3/projects/d87ecdc7728d4288a65a879f161cb9ff/users/a3be3a6eb47343c2bf1ad6a09a635eca/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.081492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87ecdc7728d4288a65a879f161cb9ff, user_id=a3be3a6eb47343c2bf1ad6a09a635eca, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.086682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 928/1890] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:17.089540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.114285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 963/1891] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:17 2022] PUT /identity/v3/projects/d87ecdc7728d4288a65a879f161cb9ff/users/a3be3a6eb47343c2bf1ad6a09a635eca/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:17.116286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.116677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.117073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.156855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] MFA Rules not processed for user `a3be3a6eb47343c2bf1ad6a09a635eca`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:17.158384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:17.298725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 929/1892] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:17.303186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.305094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:17.390940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74598897-7c62-4ad1-9d78-f1c7de2a98ac admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:17.395986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:17.396934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.397435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.397861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.411317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.413740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.426481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 964/1893] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:17.472847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.567960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91087b26-b7f1-480f-940c-05689dd08f7f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:17.577385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:17.579231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.579415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.579802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] PATH_INFO: `/v3/users/492a1eed84704edcb1669b269b25dbbb` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.582047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492a1eed84704edcb1669b269b25dbbb)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.590000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.693517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.709020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed4c36-732c-40bc-b6fe-ba3870a4e590 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:17.714572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:17.715240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.715654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.715927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] PATH_INFO: `/v3/users/074258ed3f494f1e9265346b58997c18` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.716530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492a1eed84704edcb1669b269b25dbbb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.717133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074258ed3f494f1e9265346b58997c18)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:17.719721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:17.741769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492a1eed84704edcb1669b269b25dbbb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.755314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492a1eed84704edcb1669b269b25dbbb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.763933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492a1eed84704edcb1669b269b25dbbb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.764760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-72c595c7-9d38-4452-9c62-fd253dc707e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492a1eed84704edcb1669b269b25dbbb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.773797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 930/1894] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:17 2022] DELETE /identity/v3/users/492a1eed84704edcb1669b269b25dbbb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:17.785087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.785382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.785660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.793466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074258ed3f494f1e9265346b58997c18'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.795801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:17.802488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074258ed3f494f1e9265346b58997c18'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.805499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:17.813198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074258ed3f494f1e9265346b58997c18'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.814240 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:17.815496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074258ed3f494f1e9265346b58997c18'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.815681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:17.833196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9966c01b-c430-4e0e-86e6-888aa6bba908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074258ed3f494f1e9265346b58997c18'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:17.847962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 965/1895] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:17 2022] DELETE /identity/v3/users/074258ed3f494f1e9265346b58997c18 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:17.853195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:17.853548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:17.854084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:17.881136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:17.882995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:17.894699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 931/1896] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:17.905458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.906888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:17.967113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 966/1897] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:17.980415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:17.982007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:18.001865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeadc2-ce1d-4e21-bdad-415bc7d27eed None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:18.074019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c216c-43b3-455e-ab2f-07052024f58a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:18.079419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:18.080113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:18.082029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:18.082385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:18.095954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:18.097224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:18.108348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:18.109436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:18.109830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:18.110286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:18.111236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 967/1898] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:18.123939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:18.125394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:18.142696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 932/1899] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:18.679340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:18.680900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:18.696742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:18.698656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109653-c290-4915-a8a5-297fc8757ba1 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:18.699671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:18.704139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:18.704786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:18.705062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:18.705335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] PATH_INFO: `/v3/projects/ef420f210b364a99877da2906f77486c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:18.706537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef420f210b364a99877da2906f77486c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:18.714409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:18.719686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2f6b5-67d1-43ca-b92c-91d840f36604 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:18.733390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:18.734114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:18.734319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:18.734595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] PATH_INFO: `/v3/projects/7ba04fda5aae44d090c80135133fe4d7` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:18.735875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba04fda5aae44d090c80135133fe4d7)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:18.737801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:18.789037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef420f210b364a99877da2906f77486c', 'request_id': 'req-85396aad-6616-421f-9fd4-b92a3682d260'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.828200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef420f210b364a99877da2906f77486c', 'request_id': 'req-85396aad-6616-421f-9fd4-b92a3682d260'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.843852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef420f210b364a99877da2906f77486c', 'request_id': 'req-85396aad-6616-421f-9fd4-b92a3682d260'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.844898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba04fda5aae44d090c80135133fe4d7', 'request_id': 'req-25b9ee30-c5b2-4022-b479-7c851ad84883'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.856677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] The token cache is being invalidate because project ef420f210b364a99877da2906f77486c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:18.856976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.858145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.861053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 968/1900] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:18 2022] DELETE /identity/v3/projects/ef420f210b364a99877da2906f77486c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:18.861508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba04fda5aae44d090c80135133fe4d7', 'request_id': 'req-25b9ee30-c5b2-4022-b479-7c851ad84883'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.865003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:18.866581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:18.874014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:18.875843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba04fda5aae44d090c80135133fe4d7', 'request_id': 'req-25b9ee30-c5b2-4022-b479-7c851ad84883'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.889586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:18.899196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] The token cache is being invalidate because project 7ba04fda5aae44d090c80135133fe4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:18.899549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.900334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:18.904663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 933/1901] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:18 2022] DELETE /identity/v3/projects/7ba04fda5aae44d090c80135133fe4d7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:18.909429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:18.913564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:19.012977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9ee30-c5b2-4022-b479-7c851ad84883 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:19.017690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396aad-6616-421f-9fd4-b92a3682d260 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:19.018275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:19.019156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:19.019468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:19.019921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] PATH_INFO: `/v3/users/7e50cd10f27c473a93e37f816090604e` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:19.021278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e50cd10f27c473a93e37f816090604e)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:19.023600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:19.024744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:19.025692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:19.026136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:19.026804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] PATH_INFO: `/v3/users/a3be3a6eb47343c2bf1ad6a09a635eca` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:19.028248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3be3a6eb47343c2bf1ad6a09a635eca)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:19.031950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:19.107065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e50cd10f27c473a93e37f816090604e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.107481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e50cd10f27c473a93e37f816090604e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.117846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e50cd10f27c473a93e37f816090604e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.133500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e50cd10f27c473a93e37f816090604e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.134692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e50cd10f27c473a93e37f816090604e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.146069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 934/1902] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:18 2022] DELETE /identity/v3/users/7e50cd10f27c473a93e37f816090604e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:19.178396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3be3a6eb47343c2bf1ad6a09a635eca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.199798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3be3a6eb47343c2bf1ad6a09a635eca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.226927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3be3a6eb47343c2bf1ad6a09a635eca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.227712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3be3a6eb47343c2bf1ad6a09a635eca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.260171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c732d64c-a8e1-4971-b13e-8925559cb86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3be3a6eb47343c2bf1ad6a09a635eca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:19.281467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 969/1903] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:18 2022] DELETE /identity/v3/users/a3be3a6eb47343c2bf1ad6a09a635eca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:19.813807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:19.816438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:19.892792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:19.893186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:19.893382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:19.895543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 970/1904] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:17:19.910910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:19.912766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.013743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112ff73-3877-4173-ace1-947a82120329 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.026394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:20.053289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332155d4-8328-49dc-9d62-eb23b0bb74ae None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.059776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.061718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.062008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.062303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] PATH_INFO: `/v3/projects/d87ecdc7728d4288a65a879f161cb9ff` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.065961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87ecdc7728d4288a65a879f161cb9ff)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.071527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.117102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:20.161978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87ecdc7728d4288a65a879f161cb9ff', 'request_id': 'req-b0034ef4-8619-45d6-9537-fd1c5f9fe981'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.172615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87ecdc7728d4288a65a879f161cb9ff', 'request_id': 'req-b0034ef4-8619-45d6-9537-fd1c5f9fe981'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.184765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87ecdc7728d4288a65a879f161cb9ff', 'request_id': 'req-b0034ef4-8619-45d6-9537-fd1c5f9fe981'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.199646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.202030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] The token cache is being invalidate because project d87ecdc7728d4288a65a879f161cb9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:20.202898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.203424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.204336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.204336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] PATH_INFO: `/v3/projects/7fb441e380764931a33a27e04c87d538` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.206380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b0034ef4-8619-45d6-9537-fd1c5f9fe981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.209580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb441e380764931a33a27e04c87d538)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.215951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 971/1905] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:19 2022] DELETE /identity/v3/projects/d87ecdc7728d4288a65a879f161cb9ff => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:20.217459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1cb9-c06c-4778-9407-34ade5f4173d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.217760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1cb9-c06c-4778-9407-34ade5f4173d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.218043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1cb9-c06c-4778-9407-34ade5f4173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.222739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.290231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bd7b1cb9-c06c-4778-9407-34ade5f4173d None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:20.292059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bd7b1cb9-c06c-4778-9407-34ade5f4173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.354944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb441e380764931a33a27e04c87d538', 'request_id': 'req-292e0efc-7277-4127-877b-faf3609ef303'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.370932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb441e380764931a33a27e04c87d538', 'request_id': 'req-292e0efc-7277-4127-877b-faf3609ef303'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.381817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb441e380764931a33a27e04c87d538', 'request_id': 'req-292e0efc-7277-4127-877b-faf3609ef303'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.415295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] The token cache is being invalidate because project 7fb441e380764931a33a27e04c87d538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:20.415605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.431066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-292e0efc-7277-4127-877b-faf3609ef303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:20.435723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 935/1906] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:19 2022] DELETE /identity/v3/projects/7fb441e380764931a33a27e04c87d538 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:20.437127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.439928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.440283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.488251 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 972/1907] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:20.489874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9947-021f-4565-80de-ad7367fbf315 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.493838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9947-021f-4565-80de-ad7367fbf315 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.494288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9947-021f-4565-80de-ad7367fbf315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.494809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:20.507726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.541159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-195f9947-021f-4565-80de-ad7367fbf315 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:20.546373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-195f9947-021f-4565-80de-ad7367fbf315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.607251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 936/1908] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:20.609430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.611280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.689348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:20.696258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 973/1909] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:20.698192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395167-34e2-4f06-ba51-975a89a55603 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.698479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395167-34e2-4f06-ba51-975a89a55603 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.698770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395167-34e2-4f06-ba51-975a89a55603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.732363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-20395167-34e2-4f06-ba51-975a89a55603 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:20.734379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-20395167-34e2-4f06-ba51-975a89a55603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.748228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 974/1910] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:20.749784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.750247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.750523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.781757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3462f-f400-4439-ab54-dcf14700b150 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.785195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:20.786420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:20.790641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.791416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.792032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.792366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.796656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 975/1911] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:20.798452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.805450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.809042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.817208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594a81d-a32c-4e68-9621-086221fa6a97 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.822511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.823701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 937/1912] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:20.824403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.824403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.824403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.824774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.825078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:20.825384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.827017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.838149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2748e-2df2-41a7-99e0-8760d1f0ef7d service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.844254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.845127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.845504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.845870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.846621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:20.847105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 976/1913] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:20.847246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.853058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.863628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.867292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 938/1914] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:20.872700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.876629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de7a4-ae0b-4377-906c-b9c7289206e7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.887093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa645c36-35f9-4a1e-976c-8db8293c40ce admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:20.892915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.893090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:20.893666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.894012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.894351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.894795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:20.895178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.896014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:20.896438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:20.897813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.899356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:20.905424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:20.970805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 939/1915] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:20.974892 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:20.977162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:21.013879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 977/1916] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:21.017747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.142582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b278e-5032-46e5-baef-71f8821379a5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.209975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b8a3-121c-444e-af4f-c3afebdf6751 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.217614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.218362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.218738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.219163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.221166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.223810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.258050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 978/1917] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:21 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:21.262750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.278848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef251c2-009b-4b4c-9bf5-68d3298f4bfd admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.295690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.296982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.297112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.297332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.298014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.298458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.298757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.298996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.299125 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.299884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.302148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.305997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.325922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 979/1918] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:21.330107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.356324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 940/1919] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:20 2022] POST /identity/v3/users => generated 282 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:21.360963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.364493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e20e7-f8ec-48b2-8196-a462e56028d8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.378051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.378598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.378879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.379202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.379905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.381614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e02171-8c91-487a-90e4-e8e1ee59776d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.383689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.397211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.398346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.398346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.398539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.399206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.401517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.410002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 980/1920] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:21.412035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.423246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 941/1921] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:21.427758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfd8f7-5a36-4360-89ec-325a016e033d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.428681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.442376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.456553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.456858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.457147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] PATH_INFO: `/v3/projects/604a37e240984275ad5429d2d8d1b7a1/users/3679dfc669e242f8b376e9276d55fa98/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.463990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8dde7-374c-40af-a972-4f5ae6c6fff2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.482365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.483186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.483658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.484195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.484751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.486372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.488572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604a37e240984275ad5429d2d8d1b7a1, user_id=3679dfc669e242f8b376e9276d55fa98, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.491283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204232-488e-4365-a430-fcd8d044ab99 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.515347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 942/1922] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:21.519448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.541038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 981/1923] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:21 2022] PUT /identity/v3/projects/604a37e240984275ad5429d2d8d1b7a1/users/3679dfc669e242f8b376e9276d55fa98/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:21.547444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cdf7-50e9-45cd-b87f-8c8395ce5cd5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.547743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cdf7-50e9-45cd-b87f-8c8395ce5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.548012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cdf7-50e9-45cd-b87f-8c8395ce5cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.549326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c63f-438c-47e7-90bd-1bd3fbcbab78 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.554934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:21.589845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d347cdf7-50e9-45cd-b87f-8c8395ce5cd5 None None] MFA Rules not processed for user `3679dfc669e242f8b376e9276d55fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:21.592033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d347cdf7-50e9-45cd-b87f-8c8395ce5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:21.650010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.650760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.651196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.651553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] PATH_INFO: `/v3/projects/60468a078a3043579a48a22a297e73d5/users/c1f53be42f4840699f94a7fd93e2ed8f/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.668852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60468a078a3043579a48a22a297e73d5, user_id=c1f53be42f4840699f94a7fd93e2ed8f, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.671700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.685848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 982/1924] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:21.704714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 943/1925] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:21 2022] PUT /identity/v3/projects/60468a078a3043579a48a22a297e73d5/users/c1f53be42f4840699f94a7fd93e2ed8f/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:21.706356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.706647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.706953 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.712243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.715623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:21.748424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] MFA Rules not processed for user `c1f53be42f4840699f94a7fd93e2ed8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:21.749825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:21.774011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:21.790862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fb21-3c27-42c5-90ba-13e5bf7510a7 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.796427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.797129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.797528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.797876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.831422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 983/1926] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:21.835610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.886808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.889122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.900221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 944/1927] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:21.905847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d99b3-e40a-4ec9-9bbe-c8c251f8776d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.920038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.920768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.921076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.921349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.922109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.924276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.925303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:21.936797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c6c1f-4d9c-43e3-8326-a3245e4319e7 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:21.942570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:21.943262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:21.943541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:21.943819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] PATH_INFO: `/v3/users/3679dfc669e242f8b376e9276d55fa98` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:21.944948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3679dfc669e242f8b376e9276d55fa98)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:21.947095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:21.965147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 984/1928] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:21 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:21.966034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.008731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:22.024244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3679dfc669e242f8b376e9276d55fa98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.038591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3679dfc669e242f8b376e9276d55fa98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.047197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3679dfc669e242f8b376e9276d55fa98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.056427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3679dfc669e242f8b376e9276d55fa98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.057914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e0dc6fa3-9019-4343-ad2f-7fcd9339bb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3679dfc669e242f8b376e9276d55fa98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.060305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561cb1-3afb-49ba-986b-74d713ea66a0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.065080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 945/1929] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:21 2022] DELETE /identity/v3/users/3679dfc669e242f8b376e9276d55fa98 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:22.066947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.067587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.067866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.068533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.069168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.069620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.069903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.070171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.072358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.093791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:22.095243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.107043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 985/1930] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:21 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:22.110356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.112154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.124947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb36e-b1b2-4f70-9348-0cafd69f4d36 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.159344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:22.165858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 946/1931] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:22.166863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.168323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.180284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947da33-a93b-4239-90fa-77344aafaca0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.188922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.189759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.189879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.190038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.190314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] PATH_INFO: `/v3/users/ac3314fd8c3f4068a5eacf5161202324` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.190438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.190722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.191031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.191570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3314fd8c3f4068a5eacf5161202324)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.191675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.193270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.193524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.204115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 986/1932] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:22.204790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.208946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.244768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3314fd8c3f4068a5eacf5161202324'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.258606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3314fd8c3f4068a5eacf5161202324'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.266368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3314fd8c3f4068a5eacf5161202324'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.271045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049adef-a758-4c29-96c3-c98e319da9dd admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.274298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3314fd8c3f4068a5eacf5161202324'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.274722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.274959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3314fd8c3f4068a5eacf5161202324'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.275360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.275637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.276440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.278474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.283258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 947/1933] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:22 2022] DELETE /identity/v3/users/ac3314fd8c3f4068a5eacf5161202324 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:22.283258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.284604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.297014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.298471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac076fa-8a45-42eb-af11-e7af8e9fd7a4 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.311126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 987/1934] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:22.312399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.312690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.312969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.327484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:22.335485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:22.336715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.381764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19929a3-32f3-4366-82ec-6323fb8c1a77 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.389400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.390553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.391096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.391568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] PATH_INFO: `/v3/projects/061dddced3b849099b7441df3f80059a/users/923042a4de244ee69115656c8e84a098/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.418725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=061dddced3b849099b7441df3f80059a, user_id=923042a4de244ee69115656c8e84a098, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.421727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.428841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 988/1935] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:22.439789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.441386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.443111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 948/1936] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:22 2022] PUT /identity/v3/projects/061dddced3b849099b7441df3f80059a/users/923042a4de244ee69115656c8e84a098/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:22.446706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.556736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec562ae-09c3-47fb-bfec-0e7716f3f6d0 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.568456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976351-0cd6-4ef5-a117-b3154d4cc03d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.574507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.575418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.575855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.576282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.577083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.579203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.588020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:22.595850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 949/1937] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:22.599646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.618157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ae8-625b-465a-afd8-540840f107cd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.620732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.621879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.622381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.622872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.625505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.627104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.627508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.628048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] PATH_INFO: `/v3/projects/061dddced3b849099b7441df3f80059a/users/923042a4de244ee69115656c8e84a098/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.630648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061dddced3b849099b7441df3f80059a, user_id=923042a4de244ee69115656c8e84a098, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.633372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00960cf2-a60e-427f-8d17-1728eaa00973 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.637096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.639683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.645482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 950/1938] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:22 2022] PUT /identity/v3/projects/061dddced3b849099b7441df3f80059a/users/923042a4de244ee69115656c8e84a098/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:22.658678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.658678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.658678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.660661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 989/1939] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:22.692895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] MFA Rules not processed for user `923042a4de244ee69115656c8e84a098`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:22.694403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.716708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.717950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.734841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d72405-19b6-4eff-8151-ca65f84964e5 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.820475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 951/1940] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:22.843518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:22.848429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:22.877384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:22.878145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:22.878499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:22.878872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] PATH_INFO: `/v3/projects/604a37e240984275ad5429d2d8d1b7a1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:22.880371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=604a37e240984275ad5429d2d8d1b7a1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:22.882898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:22.887961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:22.959248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3480ce-0f55-4ed5-bbce-f7f2b305ed7e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:22.969343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604a37e240984275ad5429d2d8d1b7a1', 'request_id': 'req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.983628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604a37e240984275ad5429d2d8d1b7a1', 'request_id': 'req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:22.992931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604a37e240984275ad5429d2d8d1b7a1', 'request_id': 'req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.030873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] The token cache is being invalidate because project 604a37e240984275ad5429d2d8d1b7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:23.030873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.031163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c7e8df5-a148-4eb6-93fc-7abf0872f18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.032813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 990/1941] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:22 2022] DELETE /identity/v3/projects/604a37e240984275ad5429d2d8d1b7a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:23.038082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69df81-5617-4295-949d-03d26d3ff823 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.039550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69df81-5617-4295-949d-03d26d3ff823 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.040894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69df81-5617-4295-949d-03d26d3ff823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.064926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4b69df81-5617-4295-949d-03d26d3ff823 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:23.071278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4b69df81-5617-4295-949d-03d26d3ff823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.073823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.074671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.074963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.075272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.077262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.176908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 991/1942] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:23.195986 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.196350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.196863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.225742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:23.245510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.247627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.252377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:23.255143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.281129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 952/1943] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:23.283354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.286416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.311485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 992/1944] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:23.312201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c70d0-86cf-4e82-acbd-532ecddb2ea9 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.319871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.320581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.320893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.321167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] PATH_INFO: `/v3/projects/aa3e3c2746f7462fbe231c3be57195af` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.322422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3e3c2746f7462fbe231c3be57195af)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.324054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.325078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.337953 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e2578-437e-4f6a-ac4d-9655b64ed3f2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.343524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.344051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.344329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.344818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.345235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:23.345829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.347620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.363637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 993/1945] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:23.364764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.379376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524be9-a5c3-4923-9aba-6f80854fcfa2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.385029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3e3c2746f7462fbe231c3be57195af', 'request_id': 'req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.396829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3e3c2746f7462fbe231c3be57195af', 'request_id': 'req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.405779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3e3c2746f7462fbe231c3be57195af', 'request_id': 'req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.421738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] The token cache is being invalidate because project aa3e3c2746f7462fbe231c3be57195af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:23.422131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.423072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.424806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 953/1946] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:23 2022] DELETE /identity/v3/projects/aa3e3c2746f7462fbe231c3be57195af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:23.429662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.431093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.448485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:23.455457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.456205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.456541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.456819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.457575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.460104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.501312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 994/1947] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:23 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:23.508320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.510804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.517127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80d543-8ed9-4509-bbaf-3cab03e01c4b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.602373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c071f0-acca-45ec-a86b-0c2e4805fd1d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.609037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.609930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.610314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.610690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.611625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.617243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.648021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.648691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.648970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.649245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] PATH_INFO: `/v3/users/90144673f6e64e66a8fd78f47adb722c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.651567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90144673f6e64e66a8fd78f47adb722c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.653507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.661401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 995/1948] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:23 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:23.671795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.694321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac135-f802-42ab-89b3-dcc1b8c51706 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.707107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.707902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.708502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.709030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.709829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.711612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.726743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 996/1949] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:23.731725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.748599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93363ba6-bc39-4eb7-937a-a07cb555a3a5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.760197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.760861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.761226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.761602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.762249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.764322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.774521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90144673f6e64e66a8fd78f47adb722c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.792115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 997/1950] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:23.801400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.808742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90144673f6e64e66a8fd78f47adb722c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.815595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386096-c1dc-4758-9996-4fd319f48cb7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:23.817058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90144673f6e64e66a8fd78f47adb722c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.825356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:23.826401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.826649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.827121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] PATH_INFO: `/v3/projects/9ab57b164b00415dba24d2a623698834/users/7e0fe12a5cd44e338eed9f751d8e1970/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.831867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90144673f6e64e66a8fd78f47adb722c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.833599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90144673f6e64e66a8fd78f47adb722c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:23.853081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 954/1951] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:23 2022] DELETE /identity/v3/users/90144673f6e64e66a8fd78f47adb722c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:23.879665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab57b164b00415dba24d2a623698834, user_id=7e0fe12a5cd44e338eed9f751d8e1970, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:23.884389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932070-54c8-45a1-8450-f3fefc5bb671 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:23.914003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:23.917011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.929225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 998/1952] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:23 2022] PUT /identity/v3/projects/9ab57b164b00415dba24d2a623698834/users/7e0fe12a5cd44e338eed9f751d8e1970/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:23.940253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:23.940559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:23.940837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:23.979425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:23.993576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] MFA Rules not processed for user `7e0fe12a5cd44e338eed9f751d8e1970`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:23.995196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:23.997191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:24.083450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c259-e8be-44ea-ba8c-300db195c6a3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.118776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 999/1953] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:24.127255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:24.129222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.161184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.162089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.162536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.163554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] PATH_INFO: `/v3/users/c1f53be42f4840699f94a7fd93e2ed8f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.165003 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f53be42f4840699f94a7fd93e2ed8f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:24.168634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:24.235575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c97c2-38c2-4d29-b088-6fabc47d11cb None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.239833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.240464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.241380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.241761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.253943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f53be42f4840699f94a7fd93e2ed8f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.270345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:24.272641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:24.289571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f53be42f4840699f94a7fd93e2ed8f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.295590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1000/1954] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:24.300235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f53be42f4840699f94a7fd93e2ed8f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.316437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f53be42f4840699f94a7fd93e2ed8f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.317424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0ebdca82-2087-40de-8cbc-1b8b245f995e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f53be42f4840699f94a7fd93e2ed8f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.329634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:24.332209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 955/1955] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:23 2022] DELETE /identity/v3/users/c1f53be42f4840699f94a7fd93e2ed8f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:24.332512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.336406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.337018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.337504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.352814 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81122cec-3e2e-4994-8654-80586d199c65 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.366863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:24.368520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.467621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.469172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.469458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.469740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] PATH_INFO: `/v3/users/7e0fe12a5cd44e338eed9f751d8e1970` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.472771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0fe12a5cd44e338eed9f751d8e1970)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:24.474774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:24.490196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 956/1956] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:24.501787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:24.503688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.512169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:24.547563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:24.549929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0fe12a5cd44e338eed9f751d8e1970'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.566179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0fe12a5cd44e338eed9f751d8e1970'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.578488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0fe12a5cd44e338eed9f751d8e1970'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.579232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0fe12a5cd44e338eed9f751d8e1970'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.611351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360f494-5ba4-4108-8d6d-3742fd2cfdc1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.613686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0fe12a5cd44e338eed9f751d8e1970'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.616251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.617102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.617480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.617877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.619861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.622642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1001/1957] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:24 2022] DELETE /identity/v3/users/7e0fe12a5cd44e338eed9f751d8e1970 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:24.626168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:24.628151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.639324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:24.640904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a3d4-97a5-4cb4-9578-849b84f834d3 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:24.652221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 957/1958] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:24.653584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.653996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.654270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.676374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:24.677831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.733215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76793c-2bb4-4691-809b-74aeb6660c73 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.738008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.738575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.738860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.739294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] PATH_INFO: `/v3/projects/fdd6c87954ef48229e63ee8992e5859e` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.740783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd6c87954ef48229e63ee8992e5859e)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:24.742696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:24.750851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 958/1959] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:24.761401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:24.774420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.821068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd6c87954ef48229e63ee8992e5859e', 'request_id': 'req-69cd497d-ce6a-47ce-a702-bdd60685bee7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.831956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd6c87954ef48229e63ee8992e5859e', 'request_id': 'req-69cd497d-ce6a-47ce-a702-bdd60685bee7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.840869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd6c87954ef48229e63ee8992e5859e', 'request_id': 'req-69cd497d-ce6a-47ce-a702-bdd60685bee7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.858294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] The token cache is being invalidate because project fdd6c87954ef48229e63ee8992e5859e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:24.859387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.860187 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-69cd497d-ce6a-47ce-a702-bdd60685bee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:24.862870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1002/1960] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:24 2022] DELETE /identity/v3/projects/fdd6c87954ef48229e63ee8992e5859e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:24.867283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284398-b271-47e6-a354-c9ed46346314 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.867508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca72a-50b3-499a-ae19-931ed6fd3416 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:24.867659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284398-b271-47e6-a354-c9ed46346314 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.868037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284398-b271-47e6-a354-c9ed46346314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.892277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-88284398-b271-47e6-a354-c9ed46346314 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:24.893741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-88284398-b271-47e6-a354-c9ed46346314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.931343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:24.932149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.932340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.932719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:24.935028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:24.946914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:24.965722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:24.971306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1003/1961] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:24.978627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:24.979530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:24.980076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.014382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:25.016618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.025658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.028368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.028603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1004/1962] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:25.032349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.039549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 959/1963] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:25.044472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71275e8b-a438-49f8-b330-8a41635c3b13 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.050131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.050782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.051058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.051338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.052001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:25.052309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.053928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.069879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1005/1964] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:17:25.074690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.087300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503ed4f-2cb4-450b-8daa-0c2b43a744ba service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.093841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.095020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.095675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.096238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.097369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.100111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.136062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 960/1965] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:25.140552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.155210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ced2-e37d-4479-b125-999e0dd6e7ec admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.224817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.225177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.225466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.225744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.226379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.228366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.259042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1006/1966] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:25.263614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.276533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b99c-97fb-4de7-abb6-9c7be2ccdf3c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.282442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.283097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.283384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.283666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.284385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.285963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.302444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 961/1967] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:25.306142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.320992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7b15-cd07-4da0-83f5-692654319fd3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.331751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.332573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.333000 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.333396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.334232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.336002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.352892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1007/1968] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:25.357188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.367735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f39f-3ddf-42ea-8adb-0a816a73fef6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.373752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.374447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.374727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.375062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] PATH_INFO: `/v3/projects/2e1fe5f410e545fa98a8f5cdf3fba22e/users/fe42f57cf80b49e3a0836870eba4530c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.381811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.383622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.399938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1fe5f410e545fa98a8f5cdf3fba22e, user_id=fe42f57cf80b49e3a0836870eba4530c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.403602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e7fa-93ec-4a2c-bfb9-8bdf6e086e62 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.408533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe9be0-bc82-4ad6-8ee8-1a2a3aea44ef admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.415216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.415742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.416035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.416876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] PATH_INFO: `/v3/projects/9ab57b164b00415dba24d2a623698834` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.418317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab57b164b00415dba24d2a623698834)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.421052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.449975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 962/1969] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:25 2022] PUT /identity/v3/projects/2e1fe5f410e545fa98a8f5cdf3fba22e/users/fe42f57cf80b49e3a0836870eba4530c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:25.455144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.455511 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.455696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.477431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab57b164b00415dba24d2a623698834', 'request_id': 'req-1dfa30b6-da32-494c-b63a-8c29e9b82597'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:25.488701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab57b164b00415dba24d2a623698834', 'request_id': 'req-1dfa30b6-da32-494c-b63a-8c29e9b82597'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:25.497500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab57b164b00415dba24d2a623698834', 'request_id': 'req-1dfa30b6-da32-494c-b63a-8c29e9b82597'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:25.507778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:25.509289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.511317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] The token cache is being invalidate because project 9ab57b164b00415dba24d2a623698834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:25.511769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:25.512367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1dfa30b6-da32-494c-b63a-8c29e9b82597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:25.514416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1008/1970] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:25 2022] DELETE /identity/v3/projects/9ab57b164b00415dba24d2a623698834 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:25.519449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588992b1-929a-4458-b8df-9a0920ca7139 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.520671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588992b1-929a-4458-b8df-9a0920ca7139 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.521189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588992b1-929a-4458-b8df-9a0920ca7139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.551392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-588992b1-929a-4458-b8df-9a0920ca7139 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:25.553099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-588992b1-929a-4458-b8df-9a0920ca7139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.593326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:25.648013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1009/1971] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:25.656696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.657775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.658515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.683891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:25.685493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.694625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 963/1972] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:25.707341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1010/1973] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:25.709332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.710768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:25.720106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.732810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9587-b599-479d-a440-81dc06d342ba None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.741241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.741864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.742144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.742418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.743225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:25.744080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.746742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.766593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1011/1974] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:17:25.769030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.783106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb3a7b-615b-48b0-9214-f1e65ce7f9b5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.788054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75f3c-7c09-47a7-ac1c-38287aa03935 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.790105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.791963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.792344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.792634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.793329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.794400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.795118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.795317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.795671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.796025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.806714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.808322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.814494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:25.821200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 964/1975] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:25.830616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1012/1976] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:25.832015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.843831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582cd8-5665-4f09-a0ff-def51045c961 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.930580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.932444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.932444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.932444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.933481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.935469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:25.961074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 965/1977] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:25 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:25.965438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:25.976451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4d9d-d906-436c-a3e3-49462fc2fc3d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:25.981865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:25.982488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:25.982771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:25.983081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:25.983729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:25.985351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.001419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1013/1978] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:26.002373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:26.023841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e479c0-4106-4ff6-ba84-9e2a1548dc81 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:26.032180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:26.032814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.033089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.033370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.034022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:26.035688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b2b5a-4d3e-4ecb-83ad-1657ab578d8e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.047031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 966/1979] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:26.051335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:26.062571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f867-1e55-4bd7-ac40-2282c661cf61 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:26.068429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:26.069108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.069444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.069770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] PATH_INFO: `/v3/projects/5637d9904a85471991c5574817477fa8/users/6a0a16d5f6c6480ea1a39260054faeb5/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.094463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5637d9904a85471991c5574817477fa8, user_id=6a0a16d5f6c6480ea1a39260054faeb5, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:26.097517 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.117155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1014/1980] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:26 2022] PUT /identity/v3/projects/5637d9904a85471991c5574817477fa8/users/6a0a16d5f6c6480ea1a39260054faeb5/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:26.129315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.129855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.130290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.171754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] MFA Rules not processed for user `6a0a16d5f6c6480ea1a39260054faeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:26.173719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:26.240098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:26.242074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:26.327957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 967/1981] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:26.338350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:26.339853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:26.385585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74b75-2ad1-4129-a66d-6e2989f706a1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:26.394181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:26.395123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.395608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.396076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] PATH_INFO: `/v3/projects/60468a078a3043579a48a22a297e73d5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.397435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60468a078a3043579a48a22a297e73d5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:26.400437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.439678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450974-14c9-4889-a69b-661efcc9b0a5 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:26.445251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:26.446106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.446500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.446718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.460137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:26.461941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.467129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60468a078a3043579a48a22a297e73d5', 'request_id': 'req-741ad4db-871c-42a8-9ee6-4eb58369dda2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.477782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60468a078a3043579a48a22a297e73d5', 'request_id': 'req-741ad4db-871c-42a8-9ee6-4eb58369dda2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.488810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60468a078a3043579a48a22a297e73d5', 'request_id': 'req-741ad4db-871c-42a8-9ee6-4eb58369dda2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.489928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:26.497205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 968/1982] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:26.512658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] The token cache is being invalidate because project 60468a078a3043579a48a22a297e73d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:26.512950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.514867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-741ad4db-871c-42a8-9ee6-4eb58369dda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.516957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1015/1983] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:26 2022] DELETE /identity/v3/projects/60468a078a3043579a48a22a297e73d5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:26.520896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:26.543024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80cc0-971a-4a43-befe-3460e588c568 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:26.552583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:26.647204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:26.650450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:26.651641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:26.652305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] PATH_INFO: `/v3/users/923042a4de244ee69115656c8e84a098` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:26.654513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923042a4de244ee69115656c8e84a098)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:26.656736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:26.721030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923042a4de244ee69115656c8e84a098'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.741475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923042a4de244ee69115656c8e84a098'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.755442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923042a4de244ee69115656c8e84a098'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.770580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923042a4de244ee69115656c8e84a098'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.771872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923042a4de244ee69115656c8e84a098'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:26.785062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 969/1984] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:26 2022] DELETE /identity/v3/users/923042a4de244ee69115656c8e84a098 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:27.052401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.052583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.052844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.118570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] MFA Rules not processed for user `fe42f57cf80b49e3a0836870eba4530c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:27.121647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:27.340962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:27.342567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:27.353184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1016/1985] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:27.354455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:27.358533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:27.471888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b5e5b-608e-41e1-819e-c3b37b27c8d9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:27.484512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:27.485144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.485436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.485708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.486344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:27.492098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:27.505004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2bb9-bd14-4f99-9e58-d490edfbb557 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:27.510710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:27.511649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.511931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.512217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] PATH_INFO: `/v3/projects/061dddced3b849099b7441df3f80059a` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.513794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061dddced3b849099b7441df3f80059a)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:27.517506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:27.568621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1017/1986] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:27 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:27.569663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:27.571175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:27.593340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061dddced3b849099b7441df3f80059a', 'request_id': 'req-db8cecea-ce35-4f0d-ae51-14eaadc43651'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:27.606794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061dddced3b849099b7441df3f80059a', 'request_id': 'req-db8cecea-ce35-4f0d-ae51-14eaadc43651'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:27.620832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061dddced3b849099b7441df3f80059a', 'request_id': 'req-db8cecea-ce35-4f0d-ae51-14eaadc43651'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:27.637530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] The token cache is being invalidate because project 061dddced3b849099b7441df3f80059a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:27.637828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:27.638900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-db8cecea-ce35-4f0d-ae51-14eaadc43651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:27.643632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 970/1987] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:27 2022] DELETE /identity/v3/projects/061dddced3b849099b7441df3f80059a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:27.661473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fb92-f452-4fe5-8966-608c4c852493 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.661926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fb92-f452-4fe5-8966-608c4c852493 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.662796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fb92-f452-4fe5-8966-608c4c852493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.719449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f383fb92-f452-4fe5-8966-608c4c852493 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:27.722667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f383fb92-f452-4fe5-8966-608c4c852493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:27.770748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b316bf-a20e-41a2-84e8-9386290cf7e0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:27.792218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:27.936851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 971/1988] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:27.945204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.945496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.945779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.951256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:27.954023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:27.954320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:27.954600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:27.956379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:27.958351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:27.991345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:27.992580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:28.004605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1018/1989] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:27 2022] POST /identity/v3/users => generated 292 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:28.008667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.011872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:28.014802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 972/1990] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:28.018251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.031042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fb456-513c-4f73-a88e-93c8e8c5a659 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.036905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.038367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.038719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.039400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.040077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:28.040390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.054638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.055132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd135ef-341c-4113-a8ea-0e8175967c02 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.060247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 973/1991] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:28.064876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.075313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.078118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.078118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.078118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.079411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.081066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.083733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1a2f2-2195-478d-a538-fc7bd0644c2c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.098810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.099467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.099753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.100027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.102848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.105276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.126315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1019/1992] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:28.136849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.151737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44f38-cbe6-474f-841c-0ce46cd04065 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.166142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.167041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.167339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.170943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] PATH_INFO: `/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc/users/dbefdaab54e6434ea357f0a61237dacc/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.200414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 974/1993] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:28 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:28.204737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.214854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282a5f672fc4eec99c3ff0c6f2b1bcc, user_id=dbefdaab54e6434ea357f0a61237dacc, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.218817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.263051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1020/1994] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:28 2022] PUT /identity/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc/users/dbefdaab54e6434ea357f0a61237dacc/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:28.268194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.367742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129bf7f-ad18-49c5-8aa1-ee75127548bc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.420283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:28.482698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f57e-063f-4290-8c8f-9d6600364507 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.493809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.495656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.495945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.497228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.498233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.503173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.506963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.508039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.508389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.508824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.509700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.516334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.551886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1021/1995] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:28.555267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.558628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 975/1996] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:28 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:28.567116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.581031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed2cc5-aa17-40a6-bc68-dc5ed76e9646 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.582437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ca904-035d-41fd-ae2f-f4db8a6b0a75 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.587455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.588717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.589219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.589842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.589973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.590535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.590825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.591144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.591256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] PATH_INFO: `/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc/users/dbefdaab54e6434ea357f0a61237dacc/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.593055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.593196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282a5f672fc4eec99c3ff0c6f2b1bcc, user_id=dbefdaab54e6434ea357f0a61237dacc, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.598265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.613215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 976/1997] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:28.616760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.628789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e1fd-5aeb-4ecd-b9b3-a29b91403e55 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.630220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1022/1998] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:28 2022] PUT /identity/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc/users/dbefdaab54e6434ea357f0a61237dacc/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:28.734033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.735530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.736104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.736567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.738615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.741326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630d722-dc91-4d32-b8a3-e79c5afc113b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.762458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 977/1999] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:28.763737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:28.790630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c3b6-c66a-4431-b26c-e9045a43a729 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:28.807955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:28.808870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.809200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.809522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] PATH_INFO: `/v3/projects/ceaf022b6c214fe2af5835cefb147541/users/efd41501a4924cf0bbf3aaa1d0f7cca4/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.858053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaf022b6c214fe2af5835cefb147541, user_id=efd41501a4924cf0bbf3aaa1d0f7cca4, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:28.863537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:28.893300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1023/2000] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:28 2022] PUT /identity/v3/projects/ceaf022b6c214fe2af5835cefb147541/users/efd41501a4924cf0bbf3aaa1d0f7cca4/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:28.906211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:28.906729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:28.907195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:28.949889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] MFA Rules not processed for user `efd41501a4924cf0bbf3aaa1d0f7cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:28.951835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:29.040946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 978/2001] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:29.045506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:29.075781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:29.124398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f91c2-276f-4708-8dce-79c70b0c803b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:29.129481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:29.130114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.130454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.130734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.131418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:29.133673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:29.169558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1024/2002] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:29 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:29.173786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:29.189812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9ee5-eca7-4ad5-9747-96dd431a0de1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:29.239888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:29.305961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:29.307920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.308341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.308899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.322301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:29.330224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:29.382120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 979/2003] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:29 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:29.386228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:29.420704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb0bd-3f73-40da-8abb-c876ab8386df admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:29.445323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:29.448702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.449612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.450400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.452954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:29.457256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:29.504585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1025/2004] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:29.525184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:29.563243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ea9b-8ebf-45c0-b747-8cb570cdfada admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:29.571345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:29.574156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.574630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.575187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.576552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:29.578882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe21a4-a51c-456b-987f-6342562cf053 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:29.595034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 980/2005] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:29.599152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:29.612932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f5bb-b5d4-4f1f-b9fa-815b606f3c75 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:29.622594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:29.626912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.627222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.627546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] PATH_INFO: `/v3/projects/12c871d874334672ae2035f7dcd4d330/users/0a6f9806cf0648dda14f8b6c711f8f32/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.654696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c871d874334672ae2035f7dcd4d330, user_id=0a6f9806cf0648dda14f8b6c711f8f32, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:29.657483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:29.681424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1026/2006] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:29 2022] PUT /identity/v3/projects/12c871d874334672ae2035f7dcd4d330/users/0a6f9806cf0648dda14f8b6c711f8f32/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:29.692751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:29.693532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:29.694047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:29.768103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] MFA Rules not processed for user `0a6f9806cf0648dda14f8b6c711f8f32`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:29.772772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:29.954060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 981/2007] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:29.958817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.100935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdfc13-db06-48d6-a3e0-296d4ae6520d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.109697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.111362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.111639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.112863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.113078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.115210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99984f7-f222-42aa-b77b-3baab046965c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.164949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1027/2008] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:29 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:30.168973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.182700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751deaa-d36a-4e6e-99f7-63d44a97d600 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.183113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751deaa-d36a-4e6e-99f7-63d44a97d600 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.183486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751deaa-d36a-4e6e-99f7-63d44a97d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.191887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6150bd-d114-451c-a430-eb59fb998de1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.228450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d751deaa-d36a-4e6e-99f7-63d44a97d600 None None] MFA Rules not processed for user `dbefdaab54e6434ea357f0a61237dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:30.232188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d751deaa-d36a-4e6e-99f7-63d44a97d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.326872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.328047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.328047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.328617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.331138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.334390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.337853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:30.379909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 982/2009] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:30 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:30.383913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.396732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1028/2010] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:30.408577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.408822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.409098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.409411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74343-f54b-4432-9dd6-69db7cc36c49 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.416262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.417525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.417965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.418543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.419200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.422393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.438022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 983/2011] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:30.442900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.451355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] MFA Rules not processed for user `fe42f57cf80b49e3a0836870eba4530c`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:30.452603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.467013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8531e0-0579-4b9e-af62-0e1eb6fc0824 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.472814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.474539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.474539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.474868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] PATH_INFO: `/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39/users/2ced674382f2413593d44b0757be5225/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.500883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb08e01a6c0043238dc3c00c03cc7b39, user_id=2ced674382f2413593d44b0757be5225, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.506322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.512539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:30.537434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 984/2012] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:30 2022] PUT /identity/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39/users/2ced674382f2413593d44b0757be5225/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:30.542300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.555299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1029/2013] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:30.564862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.567990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.630305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8af24-c6bf-49df-92c2-e30057e4e0bd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.638016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.638646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.639012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.639291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.639952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.641632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.664481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 985/2014] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:30.667977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.681089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30801184-43a4-4b6f-aa63-a20c77a558ef None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.683234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f908-102e-4488-8ae5-47b2cd9b8fb1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.693392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.694077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.694358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.694639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] PATH_INFO: `/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39/users/2ced674382f2413593d44b0757be5225/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.697102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb08e01a6c0043238dc3c00c03cc7b39, user_id=2ced674382f2413593d44b0757be5225, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.700494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d39539-eb37-482e-a253-80fbe6279ddd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.713773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 986/2015] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:30 2022] PUT /identity/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39/users/2ced674382f2413593d44b0757be5225/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:30.724781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.727299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.727592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.762480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] MFA Rules not processed for user `2ced674382f2413593d44b0757be5225`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:30.763740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.778516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.779261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.779637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.779984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.782717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.815267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:30.857093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.858700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.867695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 987/2016] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:30.872870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1030/2017] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:30.885624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:30.887323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:30.957176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382da391-3d02-402f-9d36-31ecc492bbd9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:30.962555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:30.963279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:30.964251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:30.964251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:30.983863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:30.986047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:30.998047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 988/2018] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:31.059975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:31.061982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:31.149307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece36af-4119-42ae-a85b-276b3355859a service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:31.155570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:31.156385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:31.156809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:31.157222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:31.315979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:31.317377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57652-53da-4aa4-b60e-7ac1913293ba service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:31.341989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1031/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:34.715453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:34.720731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:34.790830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a59c-612b-40b9-b59d-8cbf76e54bdb service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:34.804008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:34.804811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:34.805195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:34.805617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] PATH_INFO: `/v3/users/efd41501a4924cf0bbf3aaa1d0f7cca4` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:34.807582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd41501a4924cf0bbf3aaa1d0f7cca4)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:34.810533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:34.885886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd41501a4924cf0bbf3aaa1d0f7cca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:34.905855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd41501a4924cf0bbf3aaa1d0f7cca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:34.935379 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd41501a4924cf0bbf3aaa1d0f7cca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:34.945485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd41501a4924cf0bbf3aaa1d0f7cca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:34.946241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd41501a4924cf0bbf3aaa1d0f7cca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:34.952520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 989/2020] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:34 2022] DELETE /identity/v3/users/efd41501a4924cf0bbf3aaa1d0f7cca4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:34.957182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:34.957703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:34.957842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:34.979161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:34.980399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:35.044323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1032/2021] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:35.063063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:35.064499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:35.133842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f739a0-de7b-4fc6-85c9-fadae14790f9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:35.138743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:35.139660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:35.140172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:35.140471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:35.155772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:35.158347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:35.173058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 990/2022] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:36.108095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:36.110101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:36.123259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a933cd-a7d3-4902-948c-a59d9b5de1e3 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:36.128425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:36.129071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:36.129351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:36.129796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] PATH_INFO: `/v3/projects/ceaf022b6c214fe2af5835cefb147541` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:36.130955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceaf022b6c214fe2af5835cefb147541)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:36.132913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:36.151098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:36.193627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaf022b6c214fe2af5835cefb147541', 'request_id': 'req-1a78bebe-8570-4167-9672-98c88b2a63b1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.207980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaf022b6c214fe2af5835cefb147541', 'request_id': 'req-1a78bebe-8570-4167-9672-98c88b2a63b1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.218147 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaf022b6c214fe2af5835cefb147541', 'request_id': 'req-1a78bebe-8570-4167-9672-98c88b2a63b1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.234670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] The token cache is being invalidate because project ceaf022b6c214fe2af5835cefb147541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:36.235076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.236074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.242317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1033/2023] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:36 2022] DELETE /identity/v3/projects/ceaf022b6c214fe2af5835cefb147541 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:36.242503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:36.256577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5308f-cb7f-43de-883a-0633ac77d075 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:36.291874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:36.356473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:36.356702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:36.356943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:36.357234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] PATH_INFO: `/v3/users/0a6f9806cf0648dda14f8b6c711f8f32` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:36.358522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6f9806cf0648dda14f8b6c711f8f32)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:36.361164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:36.444963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6f9806cf0648dda14f8b6c711f8f32'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.461621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6f9806cf0648dda14f8b6c711f8f32'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.476278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6f9806cf0648dda14f8b6c711f8f32'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.487711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6f9806cf0648dda14f8b6c711f8f32'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.488348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6f9806cf0648dda14f8b6c711f8f32'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:36.497823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 991/2024] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:36 2022] DELETE /identity/v3/users/0a6f9806cf0648dda14f8b6c711f8f32 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:37.042451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:37.044369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.063842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78bebe-8570-4167-9672-98c88b2a63b1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:37.153648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:37.154515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.155225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.155570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] PATH_INFO: `/v3/projects/12c871d874334672ae2035f7dcd4d330` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.158954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c871d874334672ae2035f7dcd4d330)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:37.162766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:37.230177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c871d874334672ae2035f7dcd4d330', 'request_id': 'req-ca5d75d7-c2a7-4940-85b5-a47abba29e57'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.250224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c871d874334672ae2035f7dcd4d330', 'request_id': 'req-ca5d75d7-c2a7-4940-85b5-a47abba29e57'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.257857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c871d874334672ae2035f7dcd4d330', 'request_id': 'req-ca5d75d7-c2a7-4940-85b5-a47abba29e57'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.281940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] The token cache is being invalidate because project 12c871d874334672ae2035f7dcd4d330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:37.283844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.284782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.287379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1034/2025] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:37 2022] DELETE /identity/v3/projects/12c871d874334672ae2035f7dcd4d330 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:37.291553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:37.293304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.307720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28fbe-5540-47b6-8fe2-9ec98439db97 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:37.374679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:37.375553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.375901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.376425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] PATH_INFO: `/v3/users/2ced674382f2413593d44b0757be5225` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.377900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ced674382f2413593d44b0757be5225)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:37.380639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:37.419279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:37.422350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.442605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d75d7-c2a7-4940-85b5-a47abba29e57 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:37.451695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:37.453118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.453446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.453957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] PATH_INFO: `/v3/users/b8a866bebbee4ce19937f2852efaf1f1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.455813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a866bebbee4ce19937f2852efaf1f1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:37.461247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:37.470308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ced674382f2413593d44b0757be5225'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.471806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:37.494631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ced674382f2413593d44b0757be5225'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.503501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ced674382f2413593d44b0757be5225'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.517006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ced674382f2413593d44b0757be5225'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.517705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e3fabe35-2307-405e-814d-846f2fa28c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ced674382f2413593d44b0757be5225'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.524079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:37.527469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 992/2026] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:37 2022] DELETE /identity/v3/users/2ced674382f2413593d44b0757be5225 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:37.569921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a866bebbee4ce19937f2852efaf1f1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.585172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a866bebbee4ce19937f2852efaf1f1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.604159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a866bebbee4ce19937f2852efaf1f1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.605216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a866bebbee4ce19937f2852efaf1f1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.621593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a866bebbee4ce19937f2852efaf1f1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.628843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1035/2027] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:37 2022] DELETE /identity/v3/users/b8a866bebbee4ce19937f2852efaf1f1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:37.633308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.633630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.633928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.656279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:37.657906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.735881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 993/2028] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:37.747616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:37.749521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.813149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b89-7fc0-4381-a9ee-03dc01210628 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:37.816954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:37.817561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.817857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.818121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.828670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:37.829571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28382f-6aeb-4000-b3a8-db1749a87e78 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:37.836315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:37.838222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:37.844103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1036/2029] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:37.858285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91e35-2e66-462d-807f-340ac816c9db None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:37.864991 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:37.865651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.865936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.866203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] PATH_INFO: `/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.867751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb08e01a6c0043238dc3c00c03cc7b39)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:37.870371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:37.926681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb08e01a6c0043238dc3c00c03cc7b39', 'request_id': 'req-4020d52e-f68b-407e-937b-917469f09df6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.940549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb08e01a6c0043238dc3c00c03cc7b39', 'request_id': 'req-4020d52e-f68b-407e-937b-917469f09df6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.948304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb08e01a6c0043238dc3c00c03cc7b39', 'request_id': 'req-4020d52e-f68b-407e-937b-917469f09df6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.961866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] The token cache is being invalidate because project bb08e01a6c0043238dc3c00c03cc7b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:37.962169 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.963411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4020d52e-f68b-407e-937b-917469f09df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:37.965028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 994/2030] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:37 2022] DELETE /identity/v3/projects/bb08e01a6c0043238dc3c00c03cc7b39 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:37.970827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:37.971208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:37.971560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:37.996984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:37.999870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.111162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1037/2031] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:38.113262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.113777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.113888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.135526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:38.136765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.147024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 995/2032] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:38.151916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.162255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a8177-1690-4862-a98e-c8a4e4638b3f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.168011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.183264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.183640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.184064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.184799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:38.185139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.186788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.200584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1038/2033] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:38.205595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.217214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbd65-2f15-4792-9827-35e34e7d725c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.223418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.224037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.224373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.224648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.225555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.227269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.277369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 996/2034] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:38.282037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.293797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbbeea-5692-4e57-b37b-042a8a712697 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.351129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.352978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.371513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:38.390709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:38.419456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.420210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.420413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.420694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.421349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.427809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.473422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1039/2035] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:38.474065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9c53-1814-4492-89a1-83e9b6478c40 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.475123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.486252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.486766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.487079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.487362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] PATH_INFO: `/v3/projects/90454b9a5de04c6790eda77d39c2edfe` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.488586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90454b9a5de04c6790eda77d39c2edfe)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.488705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a781e-44cf-4013-b91f-95d5304943c7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.490555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.500205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.500403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.500758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.501104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.501958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.503819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.521692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1040/2036] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:38.522832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.535944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2fc4-77e3-411d-8fc4-d2fa489271d2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.541669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.542324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.542661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.543027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.543686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.545580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.561098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1041/2037] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:38.566472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.587200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f71d26-899b-431b-a01a-e263de775353 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.587317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90454b9a5de04c6790eda77d39c2edfe', 'request_id': 'req-b2eed441-38bc-4a32-abb5-37d2756fe56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:38.595773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90454b9a5de04c6790eda77d39c2edfe', 'request_id': 'req-b2eed441-38bc-4a32-abb5-37d2756fe56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:38.602275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90454b9a5de04c6790eda77d39c2edfe', 'request_id': 'req-b2eed441-38bc-4a32-abb5-37d2756fe56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:38.614659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] The token cache is being invalidate because project 90454b9a5de04c6790eda77d39c2edfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:38.614881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:38.615688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b2eed441-38bc-4a32-abb5-37d2756fe56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:38.617426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 997/2038] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:38 2022] DELETE /identity/v3/projects/90454b9a5de04c6790eda77d39c2edfe => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:38.623026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88ed9f-c452-4a7a-baca-eb6bbf99c93d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.623333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88ed9f-c452-4a7a-baca-eb6bbf99c93d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.623608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88ed9f-c452-4a7a-baca-eb6bbf99c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.649408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-fa88ed9f-c452-4a7a-baca-eb6bbf99c93d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:38.650717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fa88ed9f-c452-4a7a-baca-eb6bbf99c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.664384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.665098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.665380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.667047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] PATH_INFO: `/v3/projects/ccb8ddddda9041e1a5c33accd8af79be/users/3d04f296d39748109a8f936adff591e4/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.693112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8ddddda9041e1a5c33accd8af79be, user_id=3d04f296d39748109a8f936adff591e4, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.695879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684d71e-eb42-4c76-8585-989a82d1bc50 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.712639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1042/2039] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:38 2022] PUT /identity/v3/projects/ccb8ddddda9041e1a5c33accd8af79be/users/3d04f296d39748109a8f936adff591e4/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:38.725101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.725593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.725866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.735221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 998/2040] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:38.758322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] MFA Rules not processed for user `3d04f296d39748109a8f936adff591e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:38.759163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.759590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.760591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.761136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.800443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:38.801683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.849377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1043/2041] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:38.854812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.857425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:38.862205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:38.883901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:38.886916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 999/2042] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:38.891569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.901029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e439a-e85e-4247-9a2b-695125b0bfdf None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.906078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.906735 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.907139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.907371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.908029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:38.908337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.909970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.923739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1000/2043] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:38.928105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.939115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034a0b-b42e-4e2e-b050-ee657bd6acfc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.939667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1e6d-d8c5-45e5-87b1-3ade4b8051af None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:38.944121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.944279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:38.944724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.944829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:38.945012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.945245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:38.945359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.945525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:38.945910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.946150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:38.948110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.949772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:38.983509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1044/2044] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:38.986666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1001/2045] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:38.987806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:38.991365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.061808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03509f-ef05-48be-927d-43d3393ad5de admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.071318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90e472-79d4-4550-8b9d-39c057bd901d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.076372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.076987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.077273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.077550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.078222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.080194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.102915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1002/2046] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:39.107810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.117557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f001-9f36-4ce2-a2b5-737576014f6f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.122377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.123004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.123180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.123292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.123539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.123773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.124058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.124159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.124459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.125107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.126057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.126690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.136739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1003/2047] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:39.141068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.147797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1045/2048] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:38 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:39.151747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.153815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ca6f-faa4-49f9-8715-b641c8d61383 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.158418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.159034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.159320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.159596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.160226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.161526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bee7f-dadc-4d80-94c5-84a0472ebd9c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.161812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.166923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.167548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.167835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.168109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.168748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.170348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.173107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1004/2049] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:39.177239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.183249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1046/2050] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:39.187121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.188116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16afb7-b5fb-432b-bf63-5a63bb8b9539 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.193838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.194522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.195558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.195951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] PATH_INFO: `/v3/projects/f5c0eb58fa784cf3a6234e5e955adacf/users/1d111dc76c29499d868c5bb8cd641be5/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.198191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24a1f-48bc-4e7a-ba9a-41e48d5416e2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.204153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.204806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.205151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.205869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] PATH_INFO: `/v3/projects/6128938a84bb4b199e3100771c1dc328/users/c2c8d14948554be8a3f8a3313938fd45/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.212824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c0eb58fa784cf3a6234e5e955adacf, user_id=1d111dc76c29499d868c5bb8cd641be5, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.216411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ec9c-20f9-41d5-847c-c1e18e8e3a74 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.222270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6128938a84bb4b199e3100771c1dc328, user_id=c2c8d14948554be8a3f8a3313938fd45, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.225011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.231488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1005/2051] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:39 2022] PUT /identity/v3/projects/f5c0eb58fa784cf3a6234e5e955adacf/users/1d111dc76c29499d868c5bb8cd641be5/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:39.241964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.242261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.242530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.243655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1047/2052] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:39 2022] PUT /identity/v3/projects/6128938a84bb4b199e3100771c1dc328/users/c2c8d14948554be8a3f8a3313938fd45/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:39.247298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.252940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:39.281399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] MFA Rules not processed for user `1d111dc76c29499d868c5bb8cd641be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:39.283145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:39.329123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303636eb-b15c-4019-8850-04a24dfd6d98 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.335235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.335985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.336271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.336619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.337263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.339970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.354879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1048/2053] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:39.359164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.365124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:39.374329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0882a09-7019-421e-99bb-b7056367e4c7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.380431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.381287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.381688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.382542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] PATH_INFO: `/v3/projects/6128938a84bb4b199e3100771c1dc328/users/c2c8d14948554be8a3f8a3313938fd45/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.385282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6128938a84bb4b199e3100771c1dc328, user_id=c2c8d14948554be8a3f8a3313938fd45, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.389444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369ae42-c5c1-4579-905e-6866dfa3a1bf admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.390477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1006/2054] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:39.403465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1049/2055] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:39 2022] PUT /identity/v3/projects/6128938a84bb4b199e3100771c1dc328/users/c2c8d14948554be8a3f8a3313938fd45/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:39.412923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.412923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:39.414508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.414796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.416223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.453935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] MFA Rules not processed for user `c2c8d14948554be8a3f8a3313938fd45`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:39.455219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:39.478018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5c02-2d62-4187-803c-77cf0027031c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.533953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.534574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.534856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.535166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.541362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1050/2056] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:39.554124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:39.555782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:39.569350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5eec7-391f-4f48-a737-682d86496d6f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:39.574250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:39.575694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:39.575974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:39.576246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:39.598137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.599607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.610764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1007/2057] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:39.646738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:39.648256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02eab0-9759-4cec-9c73-dab03ed58ea1 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:39.661106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1051/2058] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:40.097966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:40.099819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:40.182299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe049-d39f-43df-9695-7365cf16bb62 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:40.187979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:40.188210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:40.188494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:40.188770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] PATH_INFO: `/v3/users/6a0a16d5f6c6480ea1a39260054faeb5` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:40.190190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0a16d5f6c6480ea1a39260054faeb5)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:40.192568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:40.194256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.242291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0a16d5f6c6480ea1a39260054faeb5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.257136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0a16d5f6c6480ea1a39260054faeb5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.265228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0a16d5f6c6480ea1a39260054faeb5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.272629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0a16d5f6c6480ea1a39260054faeb5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.273257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0a16d5f6c6480ea1a39260054faeb5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.279463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1008/2059] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:40 2022] DELETE /identity/v3/users/6a0a16d5f6c6480ea1a39260054faeb5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:40.284266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:40.284772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:40.285382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:40.305462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:40.307341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:40.311415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.375165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1052/2060] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:40.384581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:40.386730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:40.446262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e0241-0d3f-4810-bded-be871ff6bab2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:40.449987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:40.450592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:40.450873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:40.451165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:40.460199 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:40.461679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c7d7b-b15d-4067-bd76-81fac83e16ff service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:40.471168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1009/2061] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:40.853065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:40.855563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:40.882299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36983-a65c-483f-bbc3-8df78435c6d6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:40.887121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:40.887751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:40.888516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:40.888795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] PATH_INFO: `/v3/projects/5637d9904a85471991c5574817477fa8` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:40.890256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5637d9904a85471991c5574817477fa8)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:40.891882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:40.940671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5637d9904a85471991c5574817477fa8', 'request_id': 'req-2930abeb-6e2c-4168-8739-5835035c87e2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.949926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5637d9904a85471991c5574817477fa8', 'request_id': 'req-2930abeb-6e2c-4168-8739-5835035c87e2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.957065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5637d9904a85471991c5574817477fa8', 'request_id': 'req-2930abeb-6e2c-4168-8739-5835035c87e2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.969518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] The token cache is being invalidate because project 5637d9904a85471991c5574817477fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:40.969971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.970796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2930abeb-6e2c-4168-8739-5835035c87e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:40.972591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1053/2062] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:40 2022] DELETE /identity/v3/projects/5637d9904a85471991c5574817477fa8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:40.978104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8538c-01eb-4e3f-a997-da4f56bb5f01 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:40.979057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8538c-01eb-4e3f-a997-da4f56bb5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:40.979465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8538c-01eb-4e3f-a997-da4f56bb5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.000712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-6aa8538c-01eb-4e3f-a997-da4f56bb5f01 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:41.001938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6aa8538c-01eb-4e3f-a997-da4f56bb5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:41.027831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.028132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.028388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.050894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] MFA Rules not processed for user `1d111dc76c29499d868c5bb8cd641be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:41.051897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:41.088287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1010/2063] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:41.096010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851b3-2608-4899-8964-415a5d90677d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.096327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851b3-2608-4899-8964-415a5d90677d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.096571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851b3-2608-4899-8964-415a5d90677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.117593 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-229851b3-2608-4899-8964-415a5d90677d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:41.118819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-229851b3-2608-4899-8964-415a5d90677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:41.131428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1011/2064] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:41.135886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229851b3-2608-4899-8964-415a5d90677d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.136460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1054/2065] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:41.145366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229851b3-2608-4899-8964-415a5d90677d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.151069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.151887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.153551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.153551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.153551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:41.153806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.155412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.173488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1012/2066] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:41.174664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.191250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147db60-7d65-4698-a0aa-0ae076b49631 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.199468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.200658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.201158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.201656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.203114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.205284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.254116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1055/2067] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:41.258335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.265035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:41.272043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839499a2-befe-415d-94a3-c8f6f52d0181 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.351694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.352173 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.352547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.352946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.359926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.362369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.395940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1013/2068] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:41.396537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.418966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4ad4-b967-4534-813c-e2af5d898e85 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.423886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.424503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.425185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.425185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.425692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.427359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.439021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1056/2069] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:41.442061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.453205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57affc-3585-4210-ac1a-5dfbc235cf14 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.458293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.459692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.459940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.460160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.460804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.463792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de415c-0e5a-4853-b74c-313c5ef91f4d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.482890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1014/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:41.483835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.490479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:41.495971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4e94-49a8-40b8-b372-b490910f69d3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.502617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.503757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.506059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.506407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] PATH_INFO: `/v3/projects/c10181ffc5204191a765ca0b70eda451/users/3bad24bf3c1e48549a50799b230a8df2/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.527542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10181ffc5204191a765ca0b70eda451, user_id=3bad24bf3c1e48549a50799b230a8df2, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.532384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.568294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1057/2071] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:41 2022] PUT /identity/v3/projects/c10181ffc5204191a765ca0b70eda451/users/3bad24bf3c1e48549a50799b230a8df2/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:41.580506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.580805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.581250 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.618493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] MFA Rules not processed for user `3bad24bf3c1e48549a50799b230a8df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:41.620296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:41.757274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1015/2072] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:41.761983 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.878866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe393e-062e-49f6-b1f4-286f17ac1a3b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:41.893447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:41.894089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:41.894377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:41.894648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:41.895334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:41.902202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:41.960339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1058/2073] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:41.963894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:41.983645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687ebe-bb57-4ed9-bbcb-6eb9ee7c71df None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.078223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.079242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.079845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.080515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.081257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.083433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.106556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:42.113237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1016/2074] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:41 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:42.117625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.135566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4644e6-6931-4b18-8740-81ad2b5703c5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.140840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.141587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.142042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.142872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.143068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.144968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.160752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1059/2075] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:42.164629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.175898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347fbf-867d-47f2-af24-89ec9e281b4d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.180964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.182291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.182568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.183131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.183908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.185361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d57348-e1a6-4917-bf2b-15048e852e8b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.195977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1017/2076] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:42.200367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.213877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec194f7-64d6-4e08-a326-a9ec580e7d67 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.219506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.220234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.220777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.221090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] PATH_INFO: `/v3/projects/1f6571890bc043ebbf9c7144ad950769/users/cef8b6aea3134f3580a4275c01e8ecf9/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.243079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6571890bc043ebbf9c7144ad950769, user_id=cef8b6aea3134f3580a4275c01e8ecf9, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.247087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.267790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1060/2077] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:42 2022] PUT /identity/v3/projects/1f6571890bc043ebbf9c7144ad950769/users/cef8b6aea3134f3580a4275c01e8ecf9/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:42.278865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.279860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.280146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.310944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] MFA Rules not processed for user `cef8b6aea3134f3580a4275c01e8ecf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:42.312194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:42.400014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1018/2078] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:42.404801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.509466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18cff1-1484-4973-a3fc-86104b37ba22 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.515607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.516220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.516510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.516792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.517437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.520028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.559506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1061/2079] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:42 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:42.565298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.576936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347eff-c2ad-408c-9ddc-59ef9effed65 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.654855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.655573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.655910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.656198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.656897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.659035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.687967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1019/2080] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:42 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:42.689221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.708306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec989-2478-49ae-bc27-866225c1fd38 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.720918 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.723022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.724880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.725234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.727097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.733054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.802896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1062/2081] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:42.804175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.816787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845d749-0feb-4e9d-ba3c-2679c535c66c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:42.823655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:42.824431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:42.824826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:42.825201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] PATH_INFO: `/v3/projects/7b95de1d1122486baa0960a5b37fd1c3/users/79dc9fe88fef436987536e88c47bd4c2/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:42.882501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b95de1d1122486baa0960a5b37fd1c3, user_id=79dc9fe88fef436987536e88c47bd4c2, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:42.886461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:42.909356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1020/2082] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:42 2022] PUT /identity/v3/projects/7b95de1d1122486baa0960a5b37fd1c3/users/79dc9fe88fef436987536e88c47bd4c2/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:42.913589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:42.923288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:42.930287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164b4f-f005-4869-86b3-e64bfa7e74c5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:43.044596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:43.045549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:43.046023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:43.046475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:43.048268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:43.049524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46326a-131f-4a3a-8d69-77cff4717b4b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:43.062471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1063/2083] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:43.066501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:43.094839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59ec2-5397-4a85-9f4e-57b678111c32 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:43.106781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:43.107491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:43.107774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:43.108053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] PATH_INFO: `/v3/projects/7b95de1d1122486baa0960a5b37fd1c3/users/79dc9fe88fef436987536e88c47bd4c2/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:43.110053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b95de1d1122486baa0960a5b37fd1c3, user_id=79dc9fe88fef436987536e88c47bd4c2, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:43.112757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:43.141226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1021/2084] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:43 2022] PUT /identity/v3/projects/7b95de1d1122486baa0960a5b37fd1c3/users/79dc9fe88fef436987536e88c47bd4c2/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:43.151682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:43.151975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:43.152256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:43.277210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] MFA Rules not processed for user `79dc9fe88fef436987536e88c47bd4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:43.278506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:43.461692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1064/2085] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:43.472623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:43.475203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:43.576658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:43.642102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3423c-e9b6-4e49-830c-ee49ccac8bcc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:43.652296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:43.654435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:43.657903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:43.658183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:43.781666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:43.783891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064ae6-bbd8-4d2e-9ab6-06b7fbd1cfde service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:43.795775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1022/2086] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:44.520221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:44.535700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2ad8-7968-4bce-a2fe-512579449b08 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:44.539886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:44.541544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:44.542053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:44.542550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:44.544754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:44.654528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:44.657639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf39e-6960-4848-b8cf-2126d6eb7e2b service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:44.683436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1065/2087] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:45.187117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.188128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.188582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.190400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1023/2088] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:17:45.215743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7fbb-3662-4770-bd0d-53418ed8e23c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.216296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7fbb-3662-4770-bd0d-53418ed8e23c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.216978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7fbb-3662-4770-bd0d-53418ed8e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.244992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cf1e7fbb-3662-4770-bd0d-53418ed8e23c None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:45.247416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cf1e7fbb-3662-4770-bd0d-53418ed8e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:45.274864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:45.277091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:45.289018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:45.420610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864bbf-8cd7-4353-b9cc-d18040c3d3c8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:45.431932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:45.432752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1066/2089] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:45.433766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.434386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.434819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] PATH_INFO: `/v3/users/7918c9efb8504d2197556022eb9dffc1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.437042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7918c9efb8504d2197556022eb9dffc1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:45.446587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b34b0-095d-4f54-bb00-7c21a7ba82ef None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.448237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b34b0-095d-4f54-bb00-7c21a7ba82ef None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.448613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b34b0-095d-4f54-bb00-7c21a7ba82ef None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.452675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:45.455119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1067/2090] 10.222.0.30 () {54 vars in 961 bytes} [Tue Aug 30 16:17:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 16:17:45.456499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.456885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.457255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.483679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:45.485013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:45.503421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1068/2091] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Aug 30 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:45.519023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:45.534343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b6f8-3edf-4620-a084-b2bb5308d6d9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:45.543471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:45.544103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.544632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.545542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.557873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7918c9efb8504d2197556022eb9dffc1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:45.559119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:45.562347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:45.577195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1069/2092] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:45.587309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7918c9efb8504d2197556022eb9dffc1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:45.609010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7918c9efb8504d2197556022eb9dffc1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:45.622678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7918c9efb8504d2197556022eb9dffc1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:45.623329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7918c9efb8504d2197556022eb9dffc1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:45.631465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1024/2093] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:45 2022] DELETE /identity/v3/users/7918c9efb8504d2197556022eb9dffc1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:45.672100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:45.673560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:45.686675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d4ca-b345-4c40-b91b-3b99323e3b19 service placement] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:45.748176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:45.748939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:45.749377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:45.749497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:45.752237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:45.860410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:45.861893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8ef3c-b44c-49ca-9bf4-3ae82a409e62 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:45.873940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1070/2094] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:46.078252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.079861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:46.091543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:46.236162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace295e-3f3a-4abd-a4d2-7cc5583d961c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.252112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.253554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.254027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.254438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] PATH_INFO: `/v3/projects/12770db0a629489db51f1f1dc6859fb7` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.256568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12770db0a629489db51f1f1dc6859fb7)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.260608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.342120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12770db0a629489db51f1f1dc6859fb7', 'request_id': 'req-6311c739-3ea9-4a81-9b0f-7ff31a35926d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:46.361524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12770db0a629489db51f1f1dc6859fb7', 'request_id': 'req-6311c739-3ea9-4a81-9b0f-7ff31a35926d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:46.381029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12770db0a629489db51f1f1dc6859fb7', 'request_id': 'req-6311c739-3ea9-4a81-9b0f-7ff31a35926d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:46.412661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] The token cache is being invalidate because project 12770db0a629489db51f1f1dc6859fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:46.413020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:46.414693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6311c739-3ea9-4a81-9b0f-7ff31a35926d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:46.419039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1025/2095] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:46 2022] DELETE /identity/v3/projects/12770db0a629489db51f1f1dc6859fb7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:46.424676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.425108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.425547 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.462413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:46.465254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:46.554200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:46.573558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1071/2096] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:46.582576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.582876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.583322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.613508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:46.614924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:46.624869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1026/2097] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:46.628972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.644239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6170d-da20-4a59-bb72-3186d07bbcb5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.661410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.662061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.662367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.662671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.663609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:46.664094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.666435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.683070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1072/2098] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:46.685564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.703399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba23130-c0b4-4c09-9fb3-da79648f9a6d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.718214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.719108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.719557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.720058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.721510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.725975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.758575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.761286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:46.770013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1027/2099] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:46 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:46.776538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.825852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131a00-c30e-4312-88bd-54c2227403da admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.849865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06cb0-305d-40ff-849d-49a99f1ddb37 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.856649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.857287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.858002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.858278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.859244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.861256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.872939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:46.878690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.879599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.879890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.880207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.882141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:46.887025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1028/2100] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:46 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:46.891060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.901963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485454-b300-4d5a-b614-74e0ef8d1b2e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.907506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.908203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.908574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.908852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.909512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.911239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.923566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1029/2101] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:17:46.928063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.941465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb90d-fdd0-409f-ad07-2a48bba64265 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.946252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.946847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.947835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.948145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:46.949048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.951073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.957926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:46.959420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b8d3-a75a-4093-882b-31c0c5fbb7f4 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:46.963702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1030/2102] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:46.967607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:46.970668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1073/2103] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:46.981916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302e97e-fc18-41e2-a6a9-c8fb59cd5436 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:46.988402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:46.991523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:46.992016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:46.992490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] PATH_INFO: `/v3/projects/c194259a9aba4ecf8c33ffa64b078239/users/52868903541b4b7fb4ee6575de2a6d28/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:47.011778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c194259a9aba4ecf8c33ffa64b078239, user_id=52868903541b4b7fb4ee6575de2a6d28, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:47.014429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:47.030076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1031/2104] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:46 2022] PUT /identity/v3/projects/c194259a9aba4ecf8c33ffa64b078239/users/52868903541b4b7fb4ee6575de2a6d28/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:47.035436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:47.035856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:47.036170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:47.059340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:47.060568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:47.105110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:47.125589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1074/2105] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:47.135833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:47.137545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:47.196688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985ba5-86cd-4bf4-aa28-5b3c4d6730fb admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:47.201270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:47.201900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:47.202201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:47.202472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:47.212023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:47.214272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:47.225291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1032/2106] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:47.789336 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:47.790916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:47.872764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5b7b6-3758-41d7-8173-ca0a762f7c2c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:47.879116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:47.879733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:47.880175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:47.880540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:47.882518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:47.950738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:47.952237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fc888-9bf9-4a63-8c5b-d08a6826df0e service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:47.964466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1075/2107] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:50.107678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:50.109517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:50.126513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b89f-0594-4246-9919-858b74cff32a service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:50.136445 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:50.138058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:50.138716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:50.139417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] PATH_INFO: `/v3/users/3d04f296d39748109a8f936adff591e4` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:50.141635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d04f296d39748109a8f936adff591e4)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:50.144296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:50.231841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d04f296d39748109a8f936adff591e4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:50.248332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d04f296d39748109a8f936adff591e4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:50.261067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d04f296d39748109a8f936adff591e4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:50.270738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d04f296d39748109a8f936adff591e4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:50.271914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d04f296d39748109a8f936adff591e4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:50.280362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1033/2108] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:50 2022] DELETE /identity/v3/users/3d04f296d39748109a8f936adff591e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:50.285240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:50.286040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:50.286471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:50.317411 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:50.318934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:50.433796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1076/2109] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:50.443439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:50.445084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:50.490466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:50.560137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e428077-878c-4de9-948b-a77294a907c9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:50.564232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:50.564998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:50.565426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:50.565875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:50.579600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:50.581235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:50.592734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1034/2110] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:51.139373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:51.141856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:51.156858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879114b-dc5c-467b-b8f5-94b67b097e94 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:51.163207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:51.163991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:51.164643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:51.165023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] PATH_INFO: `/v3/users/3bad24bf3c1e48549a50799b230a8df2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:51.167355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bad24bf3c1e48549a50799b230a8df2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:51.169972 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:51.220033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:51.241894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bad24bf3c1e48549a50799b230a8df2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.252965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bad24bf3c1e48549a50799b230a8df2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.265017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bad24bf3c1e48549a50799b230a8df2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.265908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bad24bf3c1e48549a50799b230a8df2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.277702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:51.279271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:51.281684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-0c69960e-8158-412f-999c-51d8ebd19f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bad24bf3c1e48549a50799b230a8df2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.290080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1077/2111] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:51 2022] DELETE /identity/v3/users/3bad24bf3c1e48549a50799b230a8df2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:51.294771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:51.295100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:51.295382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:51.296493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149612e-2e17-4009-977d-d6d1115f0077 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:51.319500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:51.320822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:51.401263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1078/2112] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:51.402569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:51.404241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:51.432613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:51.433540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:51.436711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:51.437928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] PATH_INFO: `/v3/projects/ccb8ddddda9041e1a5c33accd8af79be` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:51.442387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb8ddddda9041e1a5c33accd8af79be)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:51.447925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:51.470310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3cd95-3b44-41d4-a228-b919df60cdd4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:51.474531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:51.474816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:51.475164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:51.475440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:51.487244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:51.488737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:51.510878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1079/2113] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:51.550257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb8ddddda9041e1a5c33accd8af79be', 'request_id': 'req-ff91868c-9728-4973-a13e-e9915ebb08cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.570422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb8ddddda9041e1a5c33accd8af79be', 'request_id': 'req-ff91868c-9728-4973-a13e-e9915ebb08cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.577913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb8ddddda9041e1a5c33accd8af79be', 'request_id': 'req-ff91868c-9728-4973-a13e-e9915ebb08cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.593103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] The token cache is being invalidate because project ccb8ddddda9041e1a5c33accd8af79be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:51.593399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.594464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.596561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1035/2114] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:51 2022] DELETE /identity/v3/projects/ccb8ddddda9041e1a5c33accd8af79be => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:51.600937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:51.602452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:51.623052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6546-2db5-48ae-95e0-51337cf42382 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:51.743792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:51.791973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:51.793053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:51.793559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:51.794025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] PATH_INFO: `/v3/users/c2c8d14948554be8a3f8a3313938fd45` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:51.795624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c8d14948554be8a3f8a3313938fd45)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:51.798746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:51.943186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c8d14948554be8a3f8a3313938fd45'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.966860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c8d14948554be8a3f8a3313938fd45'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.980775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c8d14948554be8a3f8a3313938fd45'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.981928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c8d14948554be8a3f8a3313938fd45'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:51.989028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:51.990739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:52.003265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c8d14948554be8a3f8a3313938fd45'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.018093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1080/2115] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:51 2022] DELETE /identity/v3/users/c2c8d14948554be8a3f8a3313938fd45 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:52.021242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91868c-9728-4973-a13e-e9915ebb08cf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:52.115143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:52.126666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:52.128162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:52.128805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:52.129317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] PATH_INFO: `/v3/projects/c10181ffc5204191a765ca0b70eda451` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:52.131546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10181ffc5204191a765ca0b70eda451)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:52.134462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:52.230900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10181ffc5204191a765ca0b70eda451', 'request_id': 'req-d0be46f2-5121-4435-a8ac-12d27fc113f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.241732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10181ffc5204191a765ca0b70eda451', 'request_id': 'req-d0be46f2-5121-4435-a8ac-12d27fc113f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.251413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10181ffc5204191a765ca0b70eda451', 'request_id': 'req-d0be46f2-5121-4435-a8ac-12d27fc113f8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.272959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] The token cache is being invalidate because project c10181ffc5204191a765ca0b70eda451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:52.273764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.274455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.277662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1036/2116] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:51 2022] DELETE /identity/v3/projects/c10181ffc5204191a765ca0b70eda451 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:52.284730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:52.287863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:52.313170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269c83-f927-4afe-aec4-d3bad645b0da admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:52.426013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:52.427024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:52.427427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:52.427807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] PATH_INFO: `/v3/users/cef8b6aea3134f3580a4275c01e8ecf9` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:52.429121 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef8b6aea3134f3580a4275c01e8ecf9)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:52.432403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:52.517026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef8b6aea3134f3580a4275c01e8ecf9'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.519617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:52.521190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:52.543447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef8b6aea3134f3580a4275c01e8ecf9'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.556848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef8b6aea3134f3580a4275c01e8ecf9'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.557433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef8b6aea3134f3580a4275c01e8ecf9'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.566190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be46f2-5121-4435-a8ac-12d27fc113f8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:52.572629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:52.580727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:52.582617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:52.583088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:52.583499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] PATH_INFO: `/v3/projects/6128938a84bb4b199e3100771c1dc328` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:52.585955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6128938a84bb4b199e3100771c1dc328)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:52.588923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-74af1f23-1c08-4b60-8efc-1576a8eba71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef8b6aea3134f3580a4275c01e8ecf9'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.589153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:52.603931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1081/2117] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:52 2022] DELETE /identity/v3/users/cef8b6aea3134f3580a4275c01e8ecf9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:52.667438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6128938a84bb4b199e3100771c1dc328', 'request_id': 'req-29a6649e-e96e-4992-b799-cf0703359297'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.678256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6128938a84bb4b199e3100771c1dc328', 'request_id': 'req-29a6649e-e96e-4992-b799-cf0703359297'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.689752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6128938a84bb4b199e3100771c1dc328', 'request_id': 'req-29a6649e-e96e-4992-b799-cf0703359297'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.716960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] The token cache is being invalidate because project 6128938a84bb4b199e3100771c1dc328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:52.717365 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.718085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-29a6649e-e96e-4992-b799-cf0703359297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:52.720164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1037/2118] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:52 2022] DELETE /identity/v3/projects/6128938a84bb4b199e3100771c1dc328 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:52.725872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:52.726272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:52.726648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:52.761555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:52.762910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:52.882333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1082/2119] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:52.891538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:52.892116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:52.892575 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:52.945325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:52.947436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:53.015047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1038/2120] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:53.018968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.045881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8592f-a175-4592-9ce7-e4cbee258c7a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.053089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.055431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.056539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.056961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.058136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:17:53.059068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.061301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.109169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1083/2121] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:17:53.115156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.137113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd58d7-54a5-4d28-9d99-72faf9d74b64 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.146019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.147235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.147696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.148149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.149461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.154131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.200429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1039/2122] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:53 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:53.204540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.218897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45432c5-ae11-43d0-9a69-765887f6ef98 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.300999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.302277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.302277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.302480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.303230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.305683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.346439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1084/2123] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:53 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:53.347794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.364444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dfbb6-5087-4df8-adfb-ed06a787c236 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.383561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.385804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.387473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.387710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.388651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.390357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.412685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1040/2124] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:53.423718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.439631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628b628-52b6-48aa-8b9a-aacc4ccc93d9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.447478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.448550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.448550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.448894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.449560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.452096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.467898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1085/2125] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:53.468425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.470480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:53.472131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.491915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe73b-1378-429c-8c81-fe5b1705e672 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.504355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.505556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.506950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.507423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] PATH_INFO: `/v3/projects/5a70a2e44ecf46b0a24a7a4b0a912fab/users/12ba2165d2ba4569855b1bbca2ebfb7d/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.518587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee44f-944a-4b3f-b917-60ae7e77cfe5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.532549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.533402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.535191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.535594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] PATH_INFO: `/v3/projects/1f6571890bc043ebbf9c7144ad950769` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.538325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6571890bc043ebbf9c7144ad950769)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.538469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a70a2e44ecf46b0a24a7a4b0a912fab, user_id=12ba2165d2ba4569855b1bbca2ebfb7d, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.541378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0784-fb9a-4f87-8c67-8f66e43e6536 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.546606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.588755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1086/2126] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:53 2022] PUT /identity/v3/projects/5a70a2e44ecf46b0a24a7a4b0a912fab/users/12ba2165d2ba4569855b1bbca2ebfb7d/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:53.593580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.595315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.596957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.635766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:53.651304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] MFA Rules not processed for user `12ba2165d2ba4569855b1bbca2ebfb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:53.653128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:53.693290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:53.710518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6571890bc043ebbf9c7144ad950769', 'request_id': 'req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:53.727544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6571890bc043ebbf9c7144ad950769', 'request_id': 'req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:53.742342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6571890bc043ebbf9c7144ad950769', 'request_id': 'req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:53.768363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] The token cache is being invalidate because project 1f6571890bc043ebbf9c7144ad950769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:53.768363 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:53.769094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:53.771324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1041/2127] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:53 2022] DELETE /identity/v3/projects/1f6571890bc043ebbf9c7144ad950769 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:53.780009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.781833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:53.807280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1087/2128] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:53.811268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:53.927833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c1d5-c1e0-4e21-9fe2-bc1b7d59b25d admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.930737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0682-0c50-49ea-99e0-1492368b3260 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:53.933089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.933727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.934007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.934338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] PATH_INFO: `/v3/users/79dc9fe88fef436987536e88c47bd4c2` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.935525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:53.935651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dc9fe88fef436987536e88c47bd4c2)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.936131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.936414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.936689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:53.937323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:53.938182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.939404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e6862-7e36-4632-a505-3e46c41975c2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:53.975335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1088/2129] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:53.976812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2c43-23dc-4df4-92ee-4aefc27994c9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:53.977099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2c43-23dc-4df4-92ee-4aefc27994c9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:53.977373 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2c43-23dc-4df4-92ee-4aefc27994c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.001968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dc9fe88fef436987536e88c47bd4c2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.014033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-812f2c43-23dc-4df4-92ee-4aefc27994c9 None None] MFA Rules not processed for user `52868903541b4b7fb4ee6575de2a6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:54.015655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-812f2c43-23dc-4df4-92ee-4aefc27994c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.018794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dc9fe88fef436987536e88c47bd4c2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.027654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dc9fe88fef436987536e88c47bd4c2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.037412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dc9fe88fef436987536e88c47bd4c2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.038045 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dc9fe88fef436987536e88c47bd4c2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.046051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1042/2130] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:17:53 2022] DELETE /identity/v3/users/79dc9fe88fef436987536e88c47bd4c2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:54.046903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.048280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.091430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.095724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1089/2131] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:54.113923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.114234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.114511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.146839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] MFA Rules not processed for user `52868903541b4b7fb4ee6575de2a6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:54.148564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.152834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72fd0-0e30-4ac5-b7de-98225f20b924 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.170278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.170910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.171385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.171666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.172412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.174711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.213798 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.229972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1043/2132] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:54 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:54.232211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.245336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1ad-a1bb-4412-9870-99fa2455fe56 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.252268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.252940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.253340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.253496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.254157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.256171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.275059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1044/2133] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:54.275059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.294404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1090/2134] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:54.302571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2891-83b8-4995-a187-849ba69d2be1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.314774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.315414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.316309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.316415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.317372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.317942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.318921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.320605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.387517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1045/2135] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:54.392089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.409915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6d32-54dc-48af-b381-2e1a21d36336 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.431864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.432618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.432928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.433616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] PATH_INFO: `/v3/projects/7f454a03d2ba478cbe3e799f2604f275/users/c49b5ccbc0e24c079dfaa969ac5fa922/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.465149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f454a03d2ba478cbe3e799f2604f275, user_id=c49b5ccbc0e24c079dfaa969ac5fa922, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.467950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e51b-4fc7-422d-a55d-0416bc6b43a3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.498343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1046/2136] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:54 2022] PUT /identity/v3/projects/7f454a03d2ba478cbe3e799f2604f275/users/c49b5ccbc0e24c079dfaa969ac5fa922/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:17:54.511354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.512713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c05b9b-6748-4c40-aeee-b7501fd263ac None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.513542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.514057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.568210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] MFA Rules not processed for user `c49b5ccbc0e24c079dfaa969ac5fa922`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:54.569711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.659974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.660932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.661752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.662270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.677708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1047/2137] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:17:54.681078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.681467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:54.755898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.757642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.782543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21683-d888-48f3-b4e0-eced1f8955ac None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.783221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1091/2138] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:54.784372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.794206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.796182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.796621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.797040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] PATH_INFO: `/v3/projects/7b95de1d1122486baa0960a5b37fd1c3` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.800028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b95de1d1122486baa0960a5b37fd1c3)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.802122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.820132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.822761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e5d6-611c-4886-85ac-827caf4cb85f service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:54.831313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:54.831652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:54.831931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:54.832200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:54.832932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:54.840477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:54.868250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.898614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1092/2139] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:17:54 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:17:54.903480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b95de1d1122486baa0960a5b37fd1c3', 'request_id': 'req-1da3634e-fa57-48e9-983d-3fb9a93c8939'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.903760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:54.921280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b95de1d1122486baa0960a5b37fd1c3', 'request_id': 'req-1da3634e-fa57-48e9-983d-3fb9a93c8939'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.936724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b95de1d1122486baa0960a5b37fd1c3', 'request_id': 'req-1da3634e-fa57-48e9-983d-3fb9a93c8939'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.953829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] The token cache is being invalidate because project 7b95de1d1122486baa0960a5b37fd1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:17:54.953829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.954719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:17:54.957153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1048/2140] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:54 2022] DELETE /identity/v3/projects/7b95de1d1122486baa0960a5b37fd1c3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:55.012810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247119b7-07da-4e18-9d28-221b44e9e29a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.027428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.032876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.032876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.032876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.032876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:55.037189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:55.113465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1093/2141] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:17:54 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:17:55.115263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:55.116719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:55.204653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3634e-fa57-48e9-983d-3fb9a93c8939 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.210094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.210958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.211373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.212512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.212761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:55.214732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:55.225952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1049/2142] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:55.230706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:55.246616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f52032-7018-4ecf-af1b-9fb321c4da08 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.251350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.252005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.252392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.252577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] PATH_INFO: `/v3/projects/457ccfdda6864be2889b47eafabfeba2/users/5a86121be45d44b2960c6b5e07d59232/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.270947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ccfdda6864be2889b47eafabfeba2, user_id=5a86121be45d44b2960c6b5e07d59232, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:55.273721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:55.291332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1094/2143] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:55 2022] PUT /identity/v3/projects/457ccfdda6864be2889b47eafabfeba2/users/5a86121be45d44b2960c6b5e07d59232/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:55.296239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:55.313332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e7af6-24d8-4c56-a7dd-c6da20e4fad1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.450599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.451254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.451533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.451809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.452459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:55.454305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dcf72-0b18-4952-acfa-0b4f6f56faa2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:55.470972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1050/2144] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:17:55.474330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:55.490196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408faab-e75e-4944-a84f-a16633f92f31 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.502706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.503591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.506043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.506404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] PATH_INFO: `/v3/projects/457ccfdda6864be2889b47eafabfeba2/users/5a86121be45d44b2960c6b5e07d59232/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.511929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ccfdda6864be2889b47eafabfeba2, user_id=5a86121be45d44b2960c6b5e07d59232, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:55.514812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:55.535408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1095/2145] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:17:55 2022] PUT /identity/v3/projects/457ccfdda6864be2889b47eafabfeba2/users/5a86121be45d44b2960c6b5e07d59232/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:17:55.544055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce58f6-a6f4-46ce-8ec0-15c84ecb6847 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.544475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce58f6-a6f4-46ce-8ec0-15c84ecb6847 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.544862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce58f6-a6f4-46ce-8ec0-15c84ecb6847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.586385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-95ce58f6-a6f4-46ce-8ec0-15c84ecb6847 None None] MFA Rules not processed for user `5a86121be45d44b2960c6b5e07d59232`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:55.597926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-95ce58f6-a6f4-46ce-8ec0-15c84ecb6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:55.627771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:55.719115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1051/2146] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:55.732912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:55.735225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:55.761377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.761667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.761937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.806689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] MFA Rules not processed for user `52868903541b4b7fb4ee6575de2a6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:55.808310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:55.894916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e438-3ce9-4347-b018-418d18354fa9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:55.904519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:55.905311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:55.905603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:55.905879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:55.908069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:55.944610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1052/2147] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:55.994256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:56.001374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078910-48b0-49d6-8f8c-53cdff118987 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:56.007277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:56.016691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1096/2148] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:57.920752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:57.950859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139bc7b-7039-4d7d-8c34-204caffec922 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:57.966598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:57.967255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:57.967552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:57.967804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:57.972777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:58.098421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:58.100000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:58.112572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1053/2149] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:17:58.864485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a5ed-3dad-4782-aba1-54793be14daf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:58.864978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a5ed-3dad-4782-aba1-54793be14daf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:58.865402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a5ed-3dad-4782-aba1-54793be14daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:58.923357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5616a5ed-3dad-4782-aba1-54793be14daf None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:58.926869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5616a5ed-3dad-4782-aba1-54793be14daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:58.959094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:58.975681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ab4d-c2e4-46e8-b2ad-c1f81709a67c service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:58.983544 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:58.984161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:58.987496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:58.987845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:59.001075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:59.002519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:59.034437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1054/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:17:59.074881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1097/2151] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:59.140515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:59.142397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:59.216608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:59.244242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53924b1d-c65c-4c18-8920-a4c9d7887ea6 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:59.250506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:59.250928 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:59.251236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:59.251510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:59.265214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:59.267477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:17:59.277516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1055/2152] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:17:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:17:59.898409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed99cb-cfb0-4898-8cde-d91c9f13e8dd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:59.898867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed99cb-cfb0-4898-8cde-d91c9f13e8dd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:59.898973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed99cb-cfb0-4898-8cde-d91c9f13e8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:59.920136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-15ed99cb-cfb0-4898-8cde-d91c9f13e8dd None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:17:59.921367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-15ed99cb-cfb0-4898-8cde-d91c9f13e8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:17:59.932742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1098/2153] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:17:59.948891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:17:59.960777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0679-6c87-4146-bd64-40c755fb6af8 service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:17:59.973454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:17:59.974325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:17:59.974864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:17:59.979082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:17:59.990824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:17:59.992828 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:00.005552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1056/2154] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:17:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:00.479097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfec9e-e82f-47f9-a067-507a3e365385 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:00.479746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfec9e-e82f-47f9-a067-507a3e365385 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:00.480387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfec9e-e82f-47f9-a067-507a3e365385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:00.509632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-33cfec9e-e82f-47f9-a067-507a3e365385 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:00.511621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-33cfec9e-e82f-47f9-a067-507a3e365385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:00.520283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1099/2155] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:00.537712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:00.550101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ae8a-d771-41dc-855e-18fafacca66f service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:00.564873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:00.565625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:00.566085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:00.566360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:00.577329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:00.579132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:00.589162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1057/2156] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:18:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:01.003712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:01.004294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:01.004294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:01.025012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:01.026427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:01.034086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1100/2157] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:01.048238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:01.059598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e576e9-6446-41a2-b981-54471186d7f2 service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:01.064788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:01.065579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:01.066014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:01.066459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:01.076796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:01.079293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3c9a-9bc8-4781-87be-c73407726006 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:01.088408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1058/2158] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:18:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:03.169292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:03.249477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a59ad-dfba-411d-9b36-5a6715f8c33f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:03.254076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:03.254708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.255023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.255295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] PATH_INFO: `/v3/users/12ba2165d2ba4569855b1bbca2ebfb7d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.256431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ba2165d2ba4569855b1bbca2ebfb7d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:03.258378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:03.308480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ba2165d2ba4569855b1bbca2ebfb7d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.316130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ba2165d2ba4569855b1bbca2ebfb7d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.324727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ba2165d2ba4569855b1bbca2ebfb7d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.325363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ba2165d2ba4569855b1bbca2ebfb7d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.339210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ba2165d2ba4569855b1bbca2ebfb7d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.348176 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1101/2159] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:03 2022] DELETE /identity/v3/users/12ba2165d2ba4569855b1bbca2ebfb7d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:03.349864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.350294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.350420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.371504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:03.372918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.380835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:03.384990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.391714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:03.436790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1059/2160] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:03.446927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:03.448311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.455033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7bf9-5998-4d5d-ae7c-74928605cd92 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:03.460751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:03.461391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.461870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.462242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] PATH_INFO: `/v3/users/1d111dc76c29499d868c5bb8cd641be5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.463604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d111dc76c29499d868c5bb8cd641be5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:03.465556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:03.510876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0d86-16aa-4ee1-b411-df202a4e40b1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:03.514792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d111dc76c29499d868c5bb8cd641be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.514926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:03.515664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.515950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.516426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.521993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d111dc76c29499d868c5bb8cd641be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.526970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:03.528472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b026f-b7c7-4edf-8e63-139abce309d7 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:03.530087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d111dc76c29499d868c5bb8cd641be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.530750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d111dc76c29499d868c5bb8cd641be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.542208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1060/2161] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:03.547716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d111dc76c29499d868c5bb8cd641be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:03.554064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1102/2162] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:03 2022] DELETE /identity/v3/users/1d111dc76c29499d868c5bb8cd641be5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:03.559371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.559665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.559946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.581222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:03.582457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.620073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:03.657966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1061/2163] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:03.664174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:03.667793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.737897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2c2d-347d-49f9-a996-8faab0b90e77 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:03.742280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:03.742970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.743884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.744157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.755208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:03.756503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929607-0730-4c19-9937-ed57c4cb3a9b service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:03.767551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1103/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:03.950321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:03.952924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:03.968322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856488e6-c9fd-441f-980c-823bea4941c6 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:03.973556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:03.974469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:03.974777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:03.975251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] PATH_INFO: `/v3/projects/f5c0eb58fa784cf3a6234e5e955adacf` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:03.976606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c0eb58fa784cf3a6234e5e955adacf)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:03.979402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.045268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c0eb58fa784cf3a6234e5e955adacf', 'request_id': 'req-bfa43497-632c-4f8c-9c72-89da5b8f87de'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.055049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c0eb58fa784cf3a6234e5e955adacf', 'request_id': 'req-bfa43497-632c-4f8c-9c72-89da5b8f87de'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.063248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c0eb58fa784cf3a6234e5e955adacf', 'request_id': 'req-bfa43497-632c-4f8c-9c72-89da5b8f87de'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.076193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] The token cache is being invalidate because project f5c0eb58fa784cf3a6234e5e955adacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:04.076489 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.077154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bfa43497-632c-4f8c-9c72-89da5b8f87de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.078875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1062/2165] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:03 2022] DELETE /identity/v3/projects/f5c0eb58fa784cf3a6234e5e955adacf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:04.084332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.084620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.084907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.108180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:04.109837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.138947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:04.188256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1104/2166] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:04.196341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.196946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.197517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.223437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:04.226429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.238034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1063/2167] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:04.242302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.258058 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee74a2-2f13-43dc-81c0-411d8e829c06 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.275095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.275095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.275095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.275095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.275752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:04.275752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.275752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.293302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1105/2168] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:18:04.298117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.311006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356b17-7a4e-48b8-ad06-0ede7a9361c2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.316302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.322546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.324472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.327670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.327968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.328254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.328940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.330902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.349724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b56ac-ea39-4232-abda-530a7c4fcf0a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.356254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.356889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.357166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.357489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] PATH_INFO: `/v3/projects/5a70a2e44ecf46b0a24a7a4b0a912fab` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.358821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a70a2e44ecf46b0a24a7a4b0a912fab)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.361205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.405212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1064/2169] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:04 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:04.412646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.447486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a70a2e44ecf46b0a24a7a4b0a912fab', 'request_id': 'req-8ae316be-758c-4306-8631-3dafd5040fe4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.457405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a70a2e44ecf46b0a24a7a4b0a912fab', 'request_id': 'req-8ae316be-758c-4306-8631-3dafd5040fe4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.467319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a70a2e44ecf46b0a24a7a4b0a912fab', 'request_id': 'req-8ae316be-758c-4306-8631-3dafd5040fe4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.481271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] The token cache is being invalidate because project 5a70a2e44ecf46b0a24a7a4b0a912fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:04.481570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.482249 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.486924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1106/2170] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:04 2022] DELETE /identity/v3/projects/5a70a2e44ecf46b0a24a7a4b0a912fab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:04.488934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.490545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.491884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2be8-14a4-407d-827f-8d17b1dd7c65 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.531279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:04.552227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.552833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.553133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.553526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.554153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.557153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.562247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae316be-758c-4306-8631-3dafd5040fe4 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.566958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.567637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.567923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.568200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] PATH_INFO: `/v3/users/c49b5ccbc0e24c079dfaa969ac5fa922` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.569337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49b5ccbc0e24c079dfaa969ac5fa922)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.571313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.582529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1065/2171] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:04 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:18:04.583584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.585579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.598170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc3a8-d918-4c8d-9cd0-3ebbb2f237b0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.604194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.604891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.605235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.605496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.606167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.607795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.613283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:04.620783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1066/2172] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:04.624458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49b5ccbc0e24c079dfaa969ac5fa922'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.625200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.632164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49b5ccbc0e24c079dfaa969ac5fa922'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.635515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb1f6-8969-4b0e-b9e8-af630eecf90c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.640308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49b5ccbc0e24c079dfaa969ac5fa922'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.640797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.640964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49b5ccbc0e24c079dfaa969ac5fa922'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.641463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.641779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.642026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.642669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.644306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.653863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-91115d5d-3a39-4abe-a43a-a333b2207e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49b5ccbc0e24c079dfaa969ac5fa922'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:04.655662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1067/2173] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:04.659904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.661664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.664552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1107/2174] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:04 2022] DELETE /identity/v3/users/c49b5ccbc0e24c079dfaa969ac5fa922 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:04.675752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f40a-9df0-444c-b605-ca8dd588c8b2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.736617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.737285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.737628 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.737905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] PATH_INFO: `/v3/projects/d11f897642f54bd892ef39dd1dffa629/users/0210d82fee6243619e3b23b651760a25/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.754743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11f897642f54bd892ef39dd1dffa629, user_id=0210d82fee6243619e3b23b651760a25, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.757570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.771016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1068/2175] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:04 2022] PUT /identity/v3/projects/d11f897642f54bd892ef39dd1dffa629/users/0210d82fee6243619e3b23b651760a25/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:04.782087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.782370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.782645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.819276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] MFA Rules not processed for user `0210d82fee6243619e3b23b651760a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:04.820518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.891440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1108/2176] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:04.903584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.905352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.944762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:04.946839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:04.968805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760320e0-fc72-42d3-ad78-581d5cb48315 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:04.973380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:04.974042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:04.974423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:04.974650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:04.986964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:04.988534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:04.998678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1069/2177] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:05.017913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e846-8532-4b04-b8ef-79ae5cea3f16 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:05.023017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:05.023658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:05.023942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:05.024238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] PATH_INFO: `/v3/projects/7f454a03d2ba478cbe3e799f2604f275` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:05.025391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f454a03d2ba478cbe3e799f2604f275)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:05.027369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:05.077542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:05.079198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f454a03d2ba478cbe3e799f2604f275', 'request_id': 'req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.094574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f454a03d2ba478cbe3e799f2604f275', 'request_id': 'req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.101778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f454a03d2ba478cbe3e799f2604f275', 'request_id': 'req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.114353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] The token cache is being invalidate because project 7f454a03d2ba478cbe3e799f2604f275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:05.114647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.115505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.118518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1109/2178] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:04 2022] DELETE /identity/v3/projects/7f454a03d2ba478cbe3e799f2604f275 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:05.122534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:05.135924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc64bd-8dd9-4c08-b134-ed70614cbd40 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:05.174328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:05.206932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:05.207744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:05.208133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:05.209154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] PATH_INFO: `/v3/users/5a86121be45d44b2960c6b5e07d59232` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:05.210205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a86121be45d44b2960c6b5e07d59232)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:05.212410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:05.268981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a86121be45d44b2960c6b5e07d59232'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.284993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a86121be45d44b2960c6b5e07d59232'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.294142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a86121be45d44b2960c6b5e07d59232'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.305774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a86121be45d44b2960c6b5e07d59232'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.306451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b8926151-a4c6-4971-be46-96c63a0daa9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a86121be45d44b2960c6b5e07d59232'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:05.316971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1070/2179] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:05 2022] DELETE /identity/v3/users/5a86121be45d44b2960c6b5e07d59232 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:06.007857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.010090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:06.028330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5423f-fac2-477c-8f6f-49dbe0f89b2c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.090368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.091022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.091311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.091590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] PATH_INFO: `/v3/projects/457ccfdda6864be2889b47eafabfeba2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.092725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=457ccfdda6864be2889b47eafabfeba2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.094634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.142327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457ccfdda6864be2889b47eafabfeba2', 'request_id': 'req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:06.151292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457ccfdda6864be2889b47eafabfeba2', 'request_id': 'req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:06.157656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457ccfdda6864be2889b47eafabfeba2', 'request_id': 'req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:06.168235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] The token cache is being invalidate because project 457ccfdda6864be2889b47eafabfeba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:06.168546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:06.169226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-207ef5b5-f393-403b-bf0e-b37afe2c0a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:06.170724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1110/2180] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:06 2022] DELETE /identity/v3/projects/457ccfdda6864be2889b47eafabfeba2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:06.176022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.176493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.176587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.197192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:06.198449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:06.257161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1071/2181] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:06.266401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.266691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.267014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.287422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:06.288630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:06.296966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1111/2182] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:06.306901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.317088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c6e88-b471-450e-9ab5-3bbdc693e843 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.322759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.323406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.323714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.323989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.324647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:06.324954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.326573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.338878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1072/2183] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:06.343410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.353269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efa748-1972-4bcf-859d-6ce50eaec90a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.358001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.358595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.358876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.359182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.359824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.361742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.389368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1112/2184] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:06 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:06.393556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.403587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6f72-07fd-48f8-a32e-0bcf02d35f78 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.444259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:06.465910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.466661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.467086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.467373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.468097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.470235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.497483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1073/2185] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:06 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:06.498621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.509545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5399eb-102c-47d4-8829-671c9a3d101f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.514146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.514799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.515115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.515392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.516033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.517631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.530878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1113/2186] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:18:06.532204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.543352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731f8c-3b7b-4b55-892b-1b1be66fd020 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.548072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.548678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.549084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.549364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.550037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.551669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09bff-a48d-47c8-a457-ace8b3a7f06f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.564336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1074/2187] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:06.576969 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.587936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1366b1-3eb3-4ef1-aade-b5ccf5259043 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.592520 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.593167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.593451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.593725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] PATH_INFO: `/v3/projects/e09330a77ad5490a820a9a96eb01306e/users/bccf5b26dee44ecf8bb869c5537329c6/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.612596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09330a77ad5490a820a9a96eb01306e, user_id=bccf5b26dee44ecf8bb869c5537329c6, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.615281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.631374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1114/2188] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:06 2022] PUT /identity/v3/projects/e09330a77ad5490a820a9a96eb01306e/users/bccf5b26dee44ecf8bb869c5537329c6/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:06.642054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.642452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.642797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.675114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] MFA Rules not processed for user `bccf5b26dee44ecf8bb869c5537329c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:06.676527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:06.754595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1075/2189] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:06.767657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:06.769435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:06.775409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:06.831684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00200c-fe13-4573-896d-aec82210fefe admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:06.840388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:06.841036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:06.841316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:06.841580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:06.851713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:06.854248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ac2ff-3ba7-4005-86a6-de513bc1f18b service glance] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:06.867782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1115/2190] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:10.214790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:10.216246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:10.286647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6c6f-a6fd-4913-832c-6a98f9e48eef None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:10.293006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:10.293646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:10.293929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:10.294205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] PATH_INFO: `/v3/users/0210d82fee6243619e3b23b651760a25` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:10.295381 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0210d82fee6243619e3b23b651760a25)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:10.297319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:10.369840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0210d82fee6243619e3b23b651760a25'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:10.373082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:10.406399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0210d82fee6243619e3b23b651760a25'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:10.420438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0210d82fee6243619e3b23b651760a25'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:10.430816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0210d82fee6243619e3b23b651760a25'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:10.431858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0210d82fee6243619e3b23b651760a25'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:10.439560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1076/2191] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:10 2022] DELETE /identity/v3/users/0210d82fee6243619e3b23b651760a25 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:10.445331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:10.446625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:10.446625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:10.467355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:10.469514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:10.553400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1116/2192] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:10.565284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:10.566373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:10.631228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2575a-e6aa-471e-89ad-857075982651 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:10.636682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:10.637292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:10.637592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:10.637827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:10.650181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:10.652014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e696e1-e970-42c7-b3fc-15d5e188c829 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:10.661841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1077/2193] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:10.949982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:10.951596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:10.965793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252f513-d4f2-4ae7-b642-89adfbe1eb2c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:10.971234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:10.971813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:10.972163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:10.972507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] PATH_INFO: `/v3/projects/d11f897642f54bd892ef39dd1dffa629` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:10.974127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11f897642f54bd892ef39dd1dffa629)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:10.976633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.033976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11f897642f54bd892ef39dd1dffa629', 'request_id': 'req-decd15be-ca50-4bdd-a7b8-75fafadc1b79'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:11.042043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11f897642f54bd892ef39dd1dffa629', 'request_id': 'req-decd15be-ca50-4bdd-a7b8-75fafadc1b79'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:11.048271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11f897642f54bd892ef39dd1dffa629', 'request_id': 'req-decd15be-ca50-4bdd-a7b8-75fafadc1b79'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:11.064017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] The token cache is being invalidate because project d11f897642f54bd892ef39dd1dffa629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:11.064315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:11.064982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-decd15be-ca50-4bdd-a7b8-75fafadc1b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:11.066503 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1117/2194] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:10 2022] DELETE /identity/v3/projects/d11f897642f54bd892ef39dd1dffa629 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:11.072227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.072515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.072792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.093245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:11.094945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:11.160431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1078/2195] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:11.169024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.169307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.169583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.190597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:11.192039 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:11.201078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1118/2196] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:11.205327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.215633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137694-60a0-41b9-a5d0-9cfc3bbc29d2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.220259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.220859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.221142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.221419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.222069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:11.222376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.224022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.240239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1079/2197] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:11.241305 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.251749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027b88-3e34-4d0f-91ba-f44f2ff78cdd None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.257194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.257800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.258079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.258535 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.259171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.262703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.287224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:11.298898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1119/2198] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:11 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:11.299899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.311055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a50a-3f2f-49b3-8161-695a64ab170f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.377092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:11.391207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.392314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.392770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.395122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.396330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.398405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.430135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1080/2199] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:11 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:18:11.432222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.444227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6676-e202-48a4-b019-18544dec6a3a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.449185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.449802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.450056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.450328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.451018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.452623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.467098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1120/2200] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:11.470238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.483079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e53ca-bb77-421e-a3bd-97695c8fa473 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.487912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.488526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.488812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.489091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.489883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.491776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c06d7-a55c-4a66-a622-cb9e3c09d660 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.505835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1081/2201] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:11.510278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.522672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cfdc2-15fa-410e-8947-c1d9fbf211ca admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.529368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.530223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.539356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.540424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] PATH_INFO: `/v3/projects/f02f571213004ddba1b10de540981fe5/users/03c92de4b0bf4f0389c20903ff8ebfba/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.560524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f571213004ddba1b10de540981fe5, user_id=03c92de4b0bf4f0389c20903ff8ebfba, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.563988 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.601673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1121/2202] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:11 2022] PUT /identity/v3/projects/f02f571213004ddba1b10de540981fe5/users/03c92de4b0bf4f0389c20903ff8ebfba/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:11.602529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb684bcb-f3bd-4fbc-b513-28b55a9ad47c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.603131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb684bcb-f3bd-4fbc-b513-28b55a9ad47c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.603591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb684bcb-f3bd-4fbc-b513-28b55a9ad47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.629010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bb684bcb-f3bd-4fbc-b513-28b55a9ad47c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:11.630653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bb684bcb-f3bd-4fbc-b513-28b55a9ad47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:11.725035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1082/2203] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:11.740799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:11.742885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:11.812003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f11b-0d48-47b9-87af-e33d8982b9d1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:11.816284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:11.817087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:11.817357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:11.817769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:11.829030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:11.830588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e582c-e6e3-4adc-bc92-1c44eb9e9677 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:11.848017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1122/2204] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:12.609421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:12.610358 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:12.611012 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:12.612620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1083/2205] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:18:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:18:12.631483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:12.632456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:12.632951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:12.665396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] MFA Rules not processed for user `21d3e6537d3347e08b1e8460b5a5c152`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:12.667156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:12.721429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:12.724156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:12.774744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455733d-4737-4926-8b2a-600b6166f79d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:12.803742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:12.804411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:12.804698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:12.804974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] PATH_INFO: `/v3/users/fe42f57cf80b49e3a0836870eba4530c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:12.807190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe42f57cf80b49e3a0836870eba4530c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:12.809164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:12.827824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1123/2206] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:18:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:12.840303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:12.844602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:12.864353 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee4629-9438-4fcf-954b-13f5b7202457 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:12.871136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992491-b589-4587-97af-ffacafa0479c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:12.872164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992491-b589-4587-97af-ffacafa0479c service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:12.872552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992491-b589-4587-97af-ffacafa0479c service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:12.872954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992491-b589-4587-97af-ffacafa0479c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:12.886324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992491-b589-4587-97af-ffacafa0479c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:12.888436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992491-b589-4587-97af-ffacafa0479c service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:12.914049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1124/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:12.919509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe42f57cf80b49e3a0836870eba4530c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:12.949219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe42f57cf80b49e3a0836870eba4530c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:12.965692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe42f57cf80b49e3a0836870eba4530c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:12.977087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe42f57cf80b49e3a0836870eba4530c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:12.978794 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe42f57cf80b49e3a0836870eba4530c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:12.990361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1084/2208] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:12 2022] DELETE /identity/v3/users/fe42f57cf80b49e3a0836870eba4530c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:13.422905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992491-b589-4587-97af-ffacafa0479c service placement] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:13.482254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992491-b589-4587-97af-ffacafa0479c service placement] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:13.596087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:13.609988 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:13.610821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:13.611306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:13.611731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] PATH_INFO: `/v3/projects/2e1fe5f410e545fa98a8f5cdf3fba22e` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:13.613261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1fe5f410e545fa98a8f5cdf3fba22e)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:13.615384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:13.697215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1fe5f410e545fa98a8f5cdf3fba22e', 'request_id': 'req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:13.710545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1fe5f410e545fa98a8f5cdf3fba22e', 'request_id': 'req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:13.721993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1fe5f410e545fa98a8f5cdf3fba22e', 'request_id': 'req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:13.739435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] The token cache is being invalidate because project 2e1fe5f410e545fa98a8f5cdf3fba22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:13.739680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:13.740362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:13.742237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1125/2209] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:13 2022] DELETE /identity/v3/projects/2e1fe5f410e545fa98a8f5cdf3fba22e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:13.746571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:13.749520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:13.770472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597406e-3286-42ad-a5f1-6330ca9e4884 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:13.854427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:13.884904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:13.885728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:13.886211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:13.887285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] PATH_INFO: `/v3/users/dbefdaab54e6434ea357f0a61237dacc` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:13.907023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbefdaab54e6434ea357f0a61237dacc)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:13.907023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:14.048062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbefdaab54e6434ea357f0a61237dacc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.078907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbefdaab54e6434ea357f0a61237dacc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.101144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbefdaab54e6434ea357f0a61237dacc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.119079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbefdaab54e6434ea357f0a61237dacc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.120139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-abe672aa-81d4-497c-829e-8d897f36a0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbefdaab54e6434ea357f0a61237dacc'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.133992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1085/2210] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:13 2022] DELETE /identity/v3/users/dbefdaab54e6434ea357f0a61237dacc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:14.606027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:14.606027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:14.621853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ff88-55d7-4ab3-85b7-7deb14dd7e4e admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:14.722821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:14.723568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:14.723753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:14.724250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] PATH_INFO: `/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:14.725756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7282a5f672fc4eec99c3ff0c6f2b1bcc)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:14.728620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:14.797006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7282a5f672fc4eec99c3ff0c6f2b1bcc', 'request_id': 'req-b23866d1-caa1-421e-a338-3a2e0ac62269'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.804387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7282a5f672fc4eec99c3ff0c6f2b1bcc', 'request_id': 'req-b23866d1-caa1-421e-a338-3a2e0ac62269'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.819031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7282a5f672fc4eec99c3ff0c6f2b1bcc', 'request_id': 'req-b23866d1-caa1-421e-a338-3a2e0ac62269'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.838902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] The token cache is being invalidate because project 7282a5f672fc4eec99c3ff0c6f2b1bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:14.838902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.838902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b23866d1-caa1-421e-a338-3a2e0ac62269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:14.843588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1126/2211] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:14 2022] DELETE /identity/v3/projects/7282a5f672fc4eec99c3ff0c6f2b1bcc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:14.845597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b206a-c10d-4649-b449-5d22f7efdd74 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:14.846076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b206a-c10d-4649-b449-5d22f7efdd74 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:14.846167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b206a-c10d-4649-b449-5d22f7efdd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:14.874124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ab0b206a-c10d-4649-b449-5d22f7efdd74 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:14.875717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ab0b206a-c10d-4649-b449-5d22f7efdd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:14.904394 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:14.905159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:14.905735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:14.951177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] MFA Rules not processed for user `7acceb819010462cb3a887d9661e4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:14.953085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:14.961192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:14.979703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1086/2212] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:14.987335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:14.987629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:14.988746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.036906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:15.039337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:15.042304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1127/2213] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:15.066018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1087/2214] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:15.067720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.092110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311e818-592f-41b9-858e-44aa062e9a40 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.101810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.102496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.102778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.103094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.103767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:15.104128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.106089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.132885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1128/2215] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:15.134298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.146923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bb0e7-23a0-4582-b0b9-39c779c20dde None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.153091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.153995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.154430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.154853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.155760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.157870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.212578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.214140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1088/2216] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:15 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:18:15.225602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b7c0-4b57-49be-8c35-3f79767ca611 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.324412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.325337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.325596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.326100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.326864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.329259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.373652 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1129/2217] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:15 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:15.377979 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.419597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703c57-3c13-40cd-8a4a-b349555275a4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.435221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.435703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.436159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.436647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.437409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.439306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.487258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1089/2218] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:18:15.491839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.515561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a77-09c9-4ab6-a580-a56ba1899901 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.531153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.532161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.532641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.533108 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.533868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.535637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff709a0-054c-4d24-9e1b-91d16913acae admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.568701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1130/2219] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:15.569704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.584782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11c5d-e239-4671-9f68-758babc5e79a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:15.612281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:15.614860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.615806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.616318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] PATH_INFO: `/v3/projects/d0cb2968863b4167beb153f2bd38ccd9/users/b0ae9d64eeff4d829c2aad25c59a4fc5/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.653645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cb2968863b4167beb153f2bd38ccd9, user_id=b0ae9d64eeff4d829c2aad25c59a4fc5, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:15.661232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:15.698757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1090/2220] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:15 2022] PUT /identity/v3/projects/d0cb2968863b4167beb153f2bd38ccd9/users/b0ae9d64eeff4d829c2aad25c59a4fc5/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:15.702045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d58-fe6f-4e4f-9e22-b42afa496b4b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:15.702615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d58-fe6f-4e4f-9e22-b42afa496b4b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:15.703137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d58-fe6f-4e4f-9e22-b42afa496b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:15.795304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d8ff3d58-fe6f-4e4f-9e22-b42afa496b4b None None] MFA Rules not processed for user `b0ae9d64eeff4d829c2aad25c59a4fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:15.796755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d8ff3d58-fe6f-4e4f-9e22-b42afa496b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:15.963581 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1131/2221] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:15.972133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:15.974360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:15.982888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:16.161112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ed56-839f-4b85-bd67-543daae7e6d8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:16.171402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:16.172155 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:16.172555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:16.172929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:16.184685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:16.186460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:16.219989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1091/2222] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:18.681146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:18.681790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:18.684637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:18.721944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:18.733869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] MFA Rules not processed for user `03c92de4b0bf4f0389c20903ff8ebfba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:18.735298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:18.833619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1132/2223] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:18.838639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:18.840856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:19.011634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ad48d-b45b-4ce1-b452-a02a42554e4c service glance] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.018566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.019496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.020023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.020471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.021279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.024864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.065307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1092/2224] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:18 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:19.068583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:19.084319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73cecb-7481-431a-85ef-0097fc1338ae None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.210524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.211687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.212030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.212308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.213037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.215391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.249871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1133/2225] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:19 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:19.254078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:19.267656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dac81-f535-4552-a8b0-0aac2f5a1bec admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.272027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.272641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.272923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.273197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.274086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.276137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.293715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:19.294171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1093/2226] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:19.310222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00bcf-8cf9-4544-870d-6cde536be9df admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.319777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.321266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.321610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.322212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] PATH_INFO: `/v3/projects/a65ecbe3ec364f0f90efb64e0818e663/users/515f2c309ebf4f058361d3263d2641f1/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.361921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65ecbe3ec364f0f90efb64e0818e663, user_id=515f2c309ebf4f058361d3263d2641f1, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.368213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.396820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1134/2227] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:19 2022] PUT /identity/v3/projects/a65ecbe3ec364f0f90efb64e0818e663/users/515f2c309ebf4f058361d3263d2641f1/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:19.398104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:19.410149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230fb7-46c0-49b8-ae93-243d3b87e9a8 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.498267 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.498868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.499688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.499688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.500088 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.501730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4375c-fd17-4a0f-ad7f-420ae7e5e37d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.515021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1094/2228] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:19.517916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:19.534921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873f79-dc0c-4958-b447-ac28b2905535 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:19.541425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:19.542283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:19.542492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:19.542940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] PATH_INFO: `/v3/projects/a65ecbe3ec364f0f90efb64e0818e663/users/515f2c309ebf4f058361d3263d2641f1/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:19.550196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65ecbe3ec364f0f90efb64e0818e663, user_id=515f2c309ebf4f058361d3263d2641f1, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:19.556339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:19.577496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1135/2229] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:19 2022] PUT /identity/v3/projects/a65ecbe3ec364f0f90efb64e0818e663/users/515f2c309ebf4f058361d3263d2641f1/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:26.206091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3826f-bc64-47a6-a165-59ab3c7fae12 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:26.206640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3826f-bc64-47a6-a165-59ab3c7fae12 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:26.206640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3826f-bc64-47a6-a165-59ab3c7fae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:26.244228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0fe3826f-bc64-47a6-a165-59ab3c7fae12 None None] MFA Rules not processed for user `515f2c309ebf4f058361d3263d2641f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:26.245638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0fe3826f-bc64-47a6-a165-59ab3c7fae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:26.252770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:26.364650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1095/2230] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:26.378705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:26.380719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:26.465782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf4ffa-04c3-4736-9e03-ab29791147f5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:26.470171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:26.470774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:26.471556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:26.471556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:26.478506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:26.560999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:26.562629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:26.582508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1136/2231] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:26.757704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:26.757704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:26.757704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:26.821218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:26.822579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:26.952294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1096/2232] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:26.966474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:26.968859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:27.117906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd24fe-81b9-48b0-acec-f77702bb98f7 service glance] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:27.123315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:27.123924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:27.124204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:27.124478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:27.138859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:27.140524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ea17-0d38-416f-b217-62f32fa9d483 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:27.152595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1137/2233] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:35.041818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:35.044608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:35.277967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19a719-54f7-420a-b6da-ede1123c3f00 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:35.283961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:35.284631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:35.284916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:35.285192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] PATH_INFO: `/v3/users/bccf5b26dee44ecf8bb869c5537329c6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:35.289854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccf5b26dee44ecf8bb869c5537329c6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:35.291954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:35.386425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccf5b26dee44ecf8bb869c5537329c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:35.389238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:35.408630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccf5b26dee44ecf8bb869c5537329c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:35.419724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccf5b26dee44ecf8bb869c5537329c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:35.438035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccf5b26dee44ecf8bb869c5537329c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:35.440264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccf5b26dee44ecf8bb869c5537329c6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:35.465454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1097/2234] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:35 2022] DELETE /identity/v3/users/bccf5b26dee44ecf8bb869c5537329c6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:35.470388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:35.471277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:35.471720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:35.512269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:35.513580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:35.625094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1138/2235] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:35.654810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:35.656700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:35.759109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8051-01d4-4d8b-b7ee-c3c403b9545b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:35.764972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:35.765633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:35.765915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:35.766192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:35.785666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:35.796730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:35.809734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1098/2236] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:36.131441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.135278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.152679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98413119-da8b-4bfe-99df-3371f09c1a49 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.168522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:36.169177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.169459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.169837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] PATH_INFO: `/v3/users/b0ae9d64eeff4d829c2aad25c59a4fc5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.171112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ae9d64eeff4d829c2aad25c59a4fc5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:36.175015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:36.244746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:36.272351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ae9d64eeff4d829c2aad25c59a4fc5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.282971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ae9d64eeff4d829c2aad25c59a4fc5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.294130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.296374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.300042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ae9d64eeff4d829c2aad25c59a4fc5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.301964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ae9d64eeff4d829c2aad25c59a4fc5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.321612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6cea8560-83bd-460c-bc56-1b169045d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ae9d64eeff4d829c2aad25c59a4fc5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.329055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1139/2237] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:36 2022] DELETE /identity/v3/users/b0ae9d64eeff4d829c2aad25c59a4fc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:36.333142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.333541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.333927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.346216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b80d1-4bef-4d60-b98d-57190fd9fa0c service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.359322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:36.360682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.451338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1140/2238] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:36.466397 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.469732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.489039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:36.491695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.492968 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.493652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] PATH_INFO: `/v3/projects/e09330a77ad5490a820a9a96eb01306e` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.495746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09330a77ad5490a820a9a96eb01306e)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:36.498233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:36.574064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09330a77ad5490a820a9a96eb01306e', 'request_id': 'req-2feae05a-c192-47c5-908f-ee65fa4b7817'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.583916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09330a77ad5490a820a9a96eb01306e', 'request_id': 'req-2feae05a-c192-47c5-908f-ee65fa4b7817'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.609152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09330a77ad5490a820a9a96eb01306e', 'request_id': 'req-2feae05a-c192-47c5-908f-ee65fa4b7817'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.625100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:36.635071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] The token cache is being invalidate because project e09330a77ad5490a820a9a96eb01306e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:36.635533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.636482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2feae05a-c192-47c5-908f-ee65fa4b7817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:36.643118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1099/2239] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:36 2022] DELETE /identity/v3/projects/e09330a77ad5490a820a9a96eb01306e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:36.645037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846eec-1296-4e1e-a3b4-1ef931a2dc9a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.645707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846eec-1296-4e1e-a3b4-1ef931a2dc9a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.646430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846eec-1296-4e1e-a3b4-1ef931a2dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.672954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-cd846eec-1296-4e1e-a3b4-1ef931a2dc9a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:36.674428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-cd846eec-1296-4e1e-a3b4-1ef931a2dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.683093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35c693-22e2-43a0-b65c-ff9ebc314f1b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.766231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1100/2240] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:36.767846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.768147 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.768604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.793134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:36.794388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.808443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1101/2241] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:36.810076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.820298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209b971-70f7-47ea-a862-60c1bac2d834 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.828301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:36.829213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.829566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.829916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.830651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:36.831066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:36.833808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:36.851706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:36.852370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1102/2242] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:36.852533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.852889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.853188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.853706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.857112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:36.864206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e720ab-1a1e-4458-8a22-62a8fab37b8c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.887833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:36.888466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:36.890100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:36.890505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:36.891216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:36.895528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:36.907018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:36.909044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:36.928587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1141/2243] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:36.947907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1103/2244] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:36 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:36.952391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:36.972074 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e00f-0333-41e7-8689-156ddca54279 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:36.983146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:37.087864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.088636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.088991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.089368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.090372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.096192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.139634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1142/2245] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:36 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:37.141471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:37.157594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493ed1c-d894-439f-bfe5-4461c82255fd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:37.164690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.165805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.166297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.166732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.167704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.169648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.202028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1104/2246] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:37.203780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:37.216038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f5c9-4ed3-41ea-ac9d-c1cccbf329e9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:37.222059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.222664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.222963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.223308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.224019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.225639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaf9fb-494c-4d31-8b79-04fb986b483d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.243800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1143/2247] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:37.245311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:37.272574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adff62-265d-496f-b8a6-4ddce9fbc29f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:37.301655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.302376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.302666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.303714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] PATH_INFO: `/v3/projects/5eaf69dcd7e543cca3fa89982fa29ae2/users/05f7aa090d824715aaecf32d97289bdb/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.328614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaf69dcd7e543cca3fa89982fa29ae2, user_id=05f7aa090d824715aaecf32d97289bdb, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.331752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.354788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1105/2248] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:37 2022] PUT /identity/v3/projects/5eaf69dcd7e543cca3fa89982fa29ae2/users/05f7aa090d824715aaecf32d97289bdb/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:37.439210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.439499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.439782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.474959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] MFA Rules not processed for user `05f7aa090d824715aaecf32d97289bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:37.476279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:37.544359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:37.546549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:37.556399 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1144/2249] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:37.567787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:37.576198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:37.673529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe55b2-dbcc-4727-8cd8-92246237e214 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:37.674561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356c92d-27f8-4732-b776-3014d9166d32 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:37.681100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.681988 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.682428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.682858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.683380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:37.684344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.684716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.685051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] PATH_INFO: `/v3/projects/d0cb2968863b4167beb153f2bd38ccd9` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.686348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cb2968863b4167beb153f2bd38ccd9)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.688764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.693716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:37.695883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515f2d5-5702-4618-ac18-33a8c31b1f15 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:37.709600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1145/2250] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:37.748528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:37.781453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cb2968863b4167beb153f2bd38ccd9', 'request_id': 'req-27ed5a8d-545e-4638-9eea-5e4063f332c4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:37.798287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cb2968863b4167beb153f2bd38ccd9', 'request_id': 'req-27ed5a8d-545e-4638-9eea-5e4063f332c4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:37.812116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cb2968863b4167beb153f2bd38ccd9', 'request_id': 'req-27ed5a8d-545e-4638-9eea-5e4063f332c4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:37.829339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] The token cache is being invalidate because project d0cb2968863b4167beb153f2bd38ccd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:37.829629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:37.830311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27ed5a8d-545e-4638-9eea-5e4063f332c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:37.832056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1106/2251] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:37 2022] DELETE /identity/v3/projects/d0cb2968863b4167beb153f2bd38ccd9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:37.837958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.838248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.838531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:37.867425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:37.869067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:37.892987 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:37.960894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1146/2252] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:37.971608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:37.972103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:37.972594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.027697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:38.029882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:38.059526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1107/2253] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:38.060034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.079403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b571a-d386-445e-80e5-4c46e1371fbe None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.100897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.102274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.102722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.102881 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.105042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:38.105378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.107296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.122485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1147/2254] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:38.127503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.158082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6648-3346-436d-8230-714f3b2f5760 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.175827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.176538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.176844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.197675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.198673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.203546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.300441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1108/2255] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:38 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:18:38.305732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.332468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288561dc-c836-4e74-b942-d6abc65246d6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.482055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.482600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.482906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.483244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.483917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.486090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.511717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1148/2256] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:38 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:38.515776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.533571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c74c8-d0ec-44d0-89e6-f3bd956d9797 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.544493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.545166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.545453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.545734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.546696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.548925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.573899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1109/2257] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:38.577188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.601077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667733-b565-47b8-bdfe-c9be86b7dedd admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.618522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.619175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.619458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.620144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.620507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.622461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21bcb-847c-499c-ad35-a34b51766071 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.637878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1149/2258] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:38.639127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.652198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2801b1d-71c8-4fbb-9978-7f2f77afe047 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.656239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.656908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.657189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.657466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] PATH_INFO: `/v3/projects/35a87fb1f8b245288ce6426c5723e10c/users/2d5173f049014939ba633b3c5c8d9cff/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.685378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a87fb1f8b245288ce6426c5723e10c, user_id=2d5173f049014939ba633b3c5c8d9cff, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.688228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.705696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1110/2259] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:38 2022] PUT /identity/v3/projects/35a87fb1f8b245288ce6426c5723e10c/users/2d5173f049014939ba633b3c5c8d9cff/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:18:38.716891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19269-d244-4394-9884-dda60588ad89 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.717458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19269-d244-4394-9884-dda60588ad89 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.717540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19269-d244-4394-9884-dda60588ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.752269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9ba19269-d244-4394-9884-dda60588ad89 None None] MFA Rules not processed for user `2d5173f049014939ba633b3c5c8d9cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:38.753415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9ba19269-d244-4394-9884-dda60588ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:38.837819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1150/2260] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:38.855447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:38.857293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:38.932268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a6da-31eb-49c7-b6c5-f470e1078d49 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:38.938872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:38.939542 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:38.939825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:38.940103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:38.950111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:38.951602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:38.962764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1111/2261] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:40.508151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe5d6-dfd6-4f0c-983c-cb5fa23bdb15 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:40.508738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe5d6-dfd6-4f0c-983c-cb5fa23bdb15 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:40.508844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe5d6-dfd6-4f0c-983c-cb5fa23bdb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:40.530424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3dcfe5d6-dfd6-4f0c-983c-cb5fa23bdb15 None None] MFA Rules not processed for user `03c92de4b0bf4f0389c20903ff8ebfba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:40.531962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3dcfe5d6-dfd6-4f0c-983c-cb5fa23bdb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:40.557327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:40.618310 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1151/2262] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:40.650821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:40.652317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:40.731733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:40.749249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418755-cadb-481c-84fb-944d3dacf352 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:40.753884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:40.754518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:40.754801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:40.755260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] PATH_INFO: `/v3/users/05f7aa090d824715aaecf32d97289bdb` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:40.756415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f7aa090d824715aaecf32d97289bdb)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:40.759212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:40.830298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f7aa090d824715aaecf32d97289bdb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:40.860618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f7aa090d824715aaecf32d97289bdb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:40.874350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f7aa090d824715aaecf32d97289bdb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:40.891304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f7aa090d824715aaecf32d97289bdb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:40.891935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f7aa090d824715aaecf32d97289bdb'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:40.900971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1112/2263] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:40 2022] DELETE /identity/v3/users/05f7aa090d824715aaecf32d97289bdb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:40.906631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:40.906963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:40.907559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:40.942329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:40.946834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:41.020009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1152/2264] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:41.031298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:41.033306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:41.124434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dffa-e852-4d75-8aef-83e3b38c63d0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:41.128360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:41.129160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:41.129630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:41.130340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:41.159858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:41.161754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8a80a-0864-41cf-b522-bf7e7bcdd140 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:41.177674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1113/2265] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:41.618112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:41.619567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:41.633991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562539ba-c7d5-4330-8c49-eab6fc1f4db6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:41.641037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:41.641815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:41.643166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:41.644171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] PATH_INFO: `/v3/projects/5eaf69dcd7e543cca3fa89982fa29ae2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:41.646255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaf69dcd7e543cca3fa89982fa29ae2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:41.650577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:41.723467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaf69dcd7e543cca3fa89982fa29ae2', 'request_id': 'req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:41.736365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaf69dcd7e543cca3fa89982fa29ae2', 'request_id': 'req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:41.745430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaf69dcd7e543cca3fa89982fa29ae2', 'request_id': 'req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:41.761272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] The token cache is being invalidate because project 5eaf69dcd7e543cca3fa89982fa29ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:41.761782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:41.762647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:41.764959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1153/2266] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:41 2022] DELETE /identity/v3/projects/5eaf69dcd7e543cca3fa89982fa29ae2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:42.050733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:42.051247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:42.051468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:42.074200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:42.075461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:42.144031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1114/2267] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:18:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:42.157618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:42.159300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:42.209643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:42.238725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6ffaa-c28c-404d-b6fb-f9d071888d26 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:42.243942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:42.244553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:42.244836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:42.245113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:42.253543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:42.255197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa51b29-3a4d-4baa-90a3-f9017562426e service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:42.264079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1154/2268] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:42.358532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:42.368669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:42.397893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:42.471413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293aff-cedd-429f-b8ab-da66aa590ae1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:42.478592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:42.479359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:42.479539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:42.480026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] PATH_INFO: `/v3/users/2d5173f049014939ba633b3c5c8d9cff` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:42.481749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5173f049014939ba633b3c5c8d9cff)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:42.484293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:42.582317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5173f049014939ba633b3c5c8d9cff'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:42.608260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5173f049014939ba633b3c5c8d9cff'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:42.623409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5173f049014939ba633b3c5c8d9cff'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:42.667158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5173f049014939ba633b3c5c8d9cff'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:42.668223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5173f049014939ba633b3c5c8d9cff'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:42.686830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1115/2269] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:18:42 2022] DELETE /identity/v3/users/2d5173f049014939ba633b3c5c8d9cff => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:42.692359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:42.693583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:42.699599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:42.740362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:42.747027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:42.869379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1155/2270] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:42.880960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:42.883075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:42.982565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee521-38f1-462e-85d2-9d393ae695bd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:42.987064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:42.987785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:42.988090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:42.988398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:42.999268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:43.001101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55bef-860c-426a-aab4-c964e6980b0e service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:43.016418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1116/2271] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:18:43.546210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:43.549648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:43.577146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca76d-aed6-4e7e-94d0-4ff069ae46e4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:43.590723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:43.591445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:43.591767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:43.592077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] PATH_INFO: `/v3/projects/35a87fb1f8b245288ce6426c5723e10c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:43.595361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a87fb1f8b245288ce6426c5723e10c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:43.612349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:43.778802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a87fb1f8b245288ce6426c5723e10c', 'request_id': 'req-95f86b01-9730-4cac-8369-4a763e36e64c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:43.793532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a87fb1f8b245288ce6426c5723e10c', 'request_id': 'req-95f86b01-9730-4cac-8369-4a763e36e64c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:43.806203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a87fb1f8b245288ce6426c5723e10c', 'request_id': 'req-95f86b01-9730-4cac-8369-4a763e36e64c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:43.830488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] The token cache is being invalidate because project 35a87fb1f8b245288ce6426c5723e10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:18:43.831217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:43.834250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-95f86b01-9730-4cac-8369-4a763e36e64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:18:43.843165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1156/2272] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:43 2022] DELETE /identity/v3/projects/35a87fb1f8b245288ce6426c5723e10c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:43.849229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:43.850085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:43.850529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:43.880174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:43.881648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:43.960021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:43.990941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1117/2273] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:43.999735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3255ee-3bff-43ef-8c50-d08cb4adaebd None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:43.999951 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3255ee-3bff-43ef-8c50-d08cb4adaebd None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.000421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3255ee-3bff-43ef-8c50-d08cb4adaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.028622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6c3255ee-3bff-43ef-8c50-d08cb4adaebd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:44.029847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6c3255ee-3bff-43ef-8c50-d08cb4adaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:44.039720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1157/2274] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:44.044063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.065855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654072-f93d-4401-b04b-c95b34cb1f47 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.068854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.069210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.069484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.072091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.072878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.073470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.073898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.075062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:18:44.075551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.077535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.095148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1118/2275] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:18:44.099112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.100658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:44.102524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:44.138198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc312bb-7174-4a67-9587-a2aa925a5c31 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.150739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.151553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.151838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.152114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.152752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.155120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.173883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:44.193296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1158/2276] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:44.211389 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1119/2277] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:18:44 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:44.213035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.237093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14bb3-0f24-4777-bb6d-35dec09a0116 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.320237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.322466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:44.390044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.390667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.390948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.391254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.391897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.393843 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.439915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1159/2278] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:18:44 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:18:44.444933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.461595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890300b-7496-4198-a496-adebdf43c6e1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.475744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.476817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.477287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.477830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.479152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.487352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.492220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3433-43d4-49c3-be9a-cce145c9e8cf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.505832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1160/2279] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:44.510864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.513935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.513935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.513935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.513935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.526352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cb353-1305-4993-b24d-c4c6376ae579 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.531619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.532474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.532914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.533584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.534342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.536451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.549228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1161/2280] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:18:44.555093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.573650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14a1e-c4c2-4235-b33d-da6e27967029 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:44.579857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:44.580699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.581341 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.581501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] PATH_INFO: `/v3/projects/52b16f7ba78a400d917a17a3822ccc2c/users/e4c10fea9c83477e9dd027f2f4db0e98/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.610582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b16f7ba78a400d917a17a3822ccc2c, user_id=e4c10fea9c83477e9dd027f2f4db0e98, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.613480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6540f-ea46-41ee-acbf-ba32cdd093aa admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.666445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1162/2281] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:18:44 2022] PUT /identity/v3/projects/52b16f7ba78a400d917a17a3822ccc2c/users/e4c10fea9c83477e9dd027f2f4db0e98/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:18:44.668258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc8d1-c07f-4367-92bc-ba71c54cd220 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:44.669326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc8d1-c07f-4367-92bc-ba71c54cd220 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:44.669326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc8d1-c07f-4367-92bc-ba71c54cd220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:44.692168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-25dcc8d1-c07f-4367-92bc-ba71c54cd220 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:44.693864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-25dcc8d1-c07f-4367-92bc-ba71c54cd220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:44.701583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:44.708448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:44.731964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1120/2282] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:18:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:44.807782 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1163/2283] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:44.818347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:44.820376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:44.990526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:45.019466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed952-00f9-4224-b3f9-f1e3565b0ec5 service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:45.146732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:45.147942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:45.148471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:45.149473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:45.184424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:45.186256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:45.219652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1121/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:46.679605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a138e-c5f0-4425-a0f2-1394b6bbd36b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:46.680760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a138e-c5f0-4425-a0f2-1394b6bbd36b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:46.681048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a138e-c5f0-4425-a0f2-1394b6bbd36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:46.764060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d93a138e-c5f0-4425-a0f2-1394b6bbd36b None None] MFA Rules not processed for user `e4c10fea9c83477e9dd027f2f4db0e98`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:46.766880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d93a138e-c5f0-4425-a0f2-1394b6bbd36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:46.876790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:46.989304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1164/2285] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:18:47.004119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:18:47.006231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:47.134965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6103223-bc94-405c-8683-e6834c4bba82 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:18:47.146599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:18:47.147687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:47.148146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:47.148578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:47.169341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:18:47.171115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646568cb-f8b6-485c-9c60-1d8e5d2f123c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:18:47.200218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1122/2286] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:18:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:18:48.895359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefafa0d-503b-46d2-9c6a-feafc2a9892a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:18:48.896126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefafa0d-503b-46d2-9c6a-feafc2a9892a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:18:48.896126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefafa0d-503b-46d2-9c6a-feafc2a9892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:18:48.931910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cefafa0d-503b-46d2-9c6a-feafc2a9892a None None] MFA Rules not processed for user `e4c10fea9c83477e9dd027f2f4db0e98`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:18:48.933267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cefafa0d-503b-46d2-9c6a-feafc2a9892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:18:48.943256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1165/2287] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:18:57.180954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=50 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:58.926071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=17 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:03.907754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:03.908639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:03.909085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:03.910481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1123/2288] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:19:03.920979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb745-3858-49e6-b11b-08f19eec22dc None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:03.921451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb745-3858-49e6-b11b-08f19eec22dc None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:03.921780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb745-3858-49e6-b11b-08f19eec22dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:03.947376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-81ceb745-3858-49e6-b11b-08f19eec22dc None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:03.948611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-81ceb745-3858-49e6-b11b-08f19eec22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:04.030210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1166/2289] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:04.044474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:04.046864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:04.122455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81127-fb55-4d16-86df-eda38feb38b6 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:04.126172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:04.126834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.127153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.127423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.138297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:04.139758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28ec28-28a6-4ea7-a5a7-b323d405bede service glance] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:04.152209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1124/2290] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:04.225621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ead0-c4fa-446a-8a9b-85dc3055610f None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.226045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ead0-c4fa-446a-8a9b-85dc3055610f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.226485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ead0-c4fa-446a-8a9b-85dc3055610f None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.227999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1167/2291] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:19:04.232923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed624-9d30-4960-bd08-033df0d8ed7a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.233281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed624-9d30-4960-bd08-033df0d8ed7a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.233620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed624-9d30-4960-bd08-033df0d8ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.254633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1d7ed624-9d30-4960-bd08-033df0d8ed7a None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:04.255876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1d7ed624-9d30-4960-bd08-033df0d8ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:04.264278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1125/2292] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:04.276186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575ead0-c4fa-446a-8a9b-85dc3055610f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:04.287268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575ead0-c4fa-446a-8a9b-85dc3055610f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:04.291641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:04.292243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.292526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.292802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.300297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:04.301745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed55db4-6e74-4bda-b331-3d300e4d742c service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:04.310562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1168/2293] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:04.431122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555029f8-79ba-426f-b128-215ff247d07b None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.431411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555029f8-79ba-426f-b128-215ff247d07b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.431866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555029f8-79ba-426f-b128-215ff247d07b None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.433203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1126/2294] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:19:04.439093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542986a-4f15-4589-a09f-715f16afa4b3 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.439582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542986a-4f15-4589-a09f-715f16afa4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.439861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542986a-4f15-4589-a09f-715f16afa4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.463838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e542986a-4f15-4589-a09f-715f16afa4b3 None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:04.465366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e542986a-4f15-4589-a09f-715f16afa4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:04.476844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1169/2295] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:19:04.487609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555029f8-79ba-426f-b128-215ff247d07b None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:04.489322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-555029f8-79ba-426f-b128-215ff247d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:04.503488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555029f8-79ba-426f-b128-215ff247d07b None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:04.507256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:04.507861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:04.508144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:04.508421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:04.518775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:04.520270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:04.531531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1127/2296] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:07.830360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f9-9817-424c-8ca2-447dc3fa0bd5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:07.830921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f9-9817-424c-8ca2-447dc3fa0bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:07.830921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f9-9817-424c-8ca2-447dc3fa0bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:07.863284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-df8604f9-9817-424c-8ca2-447dc3fa0bd5 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:07.864571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-df8604f9-9817-424c-8ca2-447dc3fa0bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:07.935490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1170/2297] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:07.963490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:08.057708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d65aa-505f-476a-bc05-9a75c739df4e service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:08.066725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:08.067500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:08.067795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:08.068131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:08.082109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:08.083780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:08.094279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1128/2298] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:17.927408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=65 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:18.089254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=67 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:28.456600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:28.457208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:28.457208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:28.480385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:28.481601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:28.490202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1171/2299] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:28.502933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:28.516073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50984b-f9a3-4a73-abb9-660a026cde51 service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:28.521625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:28.522263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:28.522758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:28.523074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:28.531412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:28.533049 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d7347-099f-463d-b080-6f0177db639c service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:28.542061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1129/2300] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:30.885003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:30.899894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea33b49-eb41-4065-869d-7eca1ee415d4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:30.904047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:30.904758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:30.905142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:30.905513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:30.907548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:30.994602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:30.996449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:31.008226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1172/2301] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:37.911135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52328a-c2ad-44a1-918f-9db0b8455170 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:37.912221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52328a-c2ad-44a1-918f-9db0b8455170 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:37.912503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52328a-c2ad-44a1-918f-9db0b8455170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:37.923625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:37.925745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:37.959940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5c52328a-c2ad-44a1-918f-9db0b8455170 None None] MFA Rules not processed for user `52868903541b4b7fb4ee6575de2a6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:37.962605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5c52328a-c2ad-44a1-918f-9db0b8455170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:38.015587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447ba8-89ce-4f88-be8e-7e25469c8045 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:38.022415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:38.022962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:38.023363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:38.023640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:38.025574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:38.037876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:38.039177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1130/2302] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:38.039595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9183183-5263-47c1-9c34-d3a0d5696e89 service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:38.049836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1173/2303] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:19:42.703193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:42.705731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:42.706019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:42.731115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] MFA Rules not processed for user `7acceb819010462cb3a887d9661e4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:42.732659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:42.791757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1131/2304] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:44.011494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615a8b-ecd8-43b1-87b2-5aa6f879c40b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:44.012040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615a8b-ecd8-43b1-87b2-5aa6f879c40b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:44.012040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615a8b-ecd8-43b1-87b2-5aa6f879c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:44.033157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-12615a8b-ecd8-43b1-87b2-5aa6f879c40b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:44.034404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-12615a8b-ecd8-43b1-87b2-5aa6f879c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:44.043118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1174/2305] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:44.063774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:44.065107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:44.081812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306281-12a5-4ebc-ac6c-68cdfdd4a260 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:44.087442 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:44.088070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:44.088353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:44.088623 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:44.096645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:44.098224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:44.107953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1132/2306] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:47.119072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895d3bc-0aae-4b52-b17a-5fb7604a899f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:47.119513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895d3bc-0aae-4b52-b17a-5fb7604a899f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:47.119704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895d3bc-0aae-4b52-b17a-5fb7604a899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:47.141921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-5895d3bc-0aae-4b52-b17a-5fb7604a899f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:47.143152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5895d3bc-0aae-4b52-b17a-5fb7604a899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:47.152017 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1175/2307] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:47.169352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:47.170764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:47.185332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d11d4-4ae2-49c4-aad2-c3627dae9f24 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:47.190670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:47.191287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:47.191566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:47.191836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:47.200683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:47.202241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:47.212500 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1133/2308] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:51.425774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99771-89b5-4040-a1e8-c54e43090435 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:51.426282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99771-89b5-4040-a1e8-c54e43090435 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:51.426430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99771-89b5-4040-a1e8-c54e43090435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:51.448891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bba99771-89b5-4040-a1e8-c54e43090435 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:51.450168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bba99771-89b5-4040-a1e8-c54e43090435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:51.463580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1176/2309] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:51.486257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:51.498128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500580-41ed-40a7-bbc7-25c2a2dc0a2f service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:51.503889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:51.505663 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:51.505962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:51.506239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:51.515072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:51.516653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:51.527184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1134/2310] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:56.568046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a97c-1f5d-4e4c-b150-84124d18f564 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:56.568610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a97c-1f5d-4e4c-b150-84124d18f564 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:56.568610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a97c-1f5d-4e4c-b150-84124d18f564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:56.590326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-53b5a97c-1f5d-4e4c-b150-84124d18f564 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:19:56.592008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-53b5a97c-1f5d-4e4c-b150-84124d18f564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:19:56.604130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1177/2311] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:19:56.628151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:19:56.639476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7fbc-d03a-4ea1-8812-a6379120c12e service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:19:56.645522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:19:56.646133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:19:56.646416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:19:56.646696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:19:56.658844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:19:56.661746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:19:56.672459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1135/2312] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:01.784222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b72c5d-9933-47f5-a71d-73015627b1c2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:01.784748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b72c5d-9933-47f5-a71d-73015627b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:01.784748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b72c5d-9933-47f5-a71d-73015627b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:01.792286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=78 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:01.805374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-33b72c5d-9933-47f5-a71d-73015627b1c2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:01.806577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-33b72c5d-9933-47f5-a71d-73015627b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:01.814396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1178/2313] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:01.837347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:01.843017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=81 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:01.849822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d59-9047-4efc-ae41-f45dc12f4ed9 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:01.855675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:01.856271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:01.856552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:01.856827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:01.865814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:01.867501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:01.877077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1136/2314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:04.944993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbae5-015e-4ad8-b5d3-b59509ae89b8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:04.945485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbae5-015e-4ad8-b5d3-b59509ae89b8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:04.945587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbae5-015e-4ad8-b5d3-b59509ae89b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:04.965059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cfefbae5-015e-4ad8-b5d3-b59509ae89b8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:04.966243 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cfefbae5-015e-4ad8-b5d3-b59509ae89b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:04.973890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1179/2315] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:04.995721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:05.007707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640386-a04c-461f-8987-2f3165d2f3a9 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:05.013146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:05.013742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:05.014025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:05.014302 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:05.023093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:05.024670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2823-34b9-4f30-afa1-ddd96e229d61 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:05.034021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1137/2316] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:14.960109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:15.029756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=11 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:21.430289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466910-a318-477d-89d5-86f461b4e700 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:21.430778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466910-a318-477d-89d5-86f461b4e700 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:21.430871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466910-a318-477d-89d5-86f461b4e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:21.449975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a9466910-a318-477d-89d5-86f461b4e700 None None] MFA Rules not processed for user `e4c10fea9c83477e9dd027f2f4db0e98`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:21.451203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a9466910-a318-477d-89d5-86f461b4e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:21.457999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1180/2317] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:20:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:30.513120 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:30.513660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:30.513851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:30.533970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] MFA Rules not processed for user `1080f0e19dd84503af28318412466485`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:30.535221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:30.591939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1138/2318] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:20:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:20:31.445329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:40.584873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=25 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:40.918104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2c8a-edc0-42ad-9eb5-5e88dd4ea25c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:40.918651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2c8a-edc0-42ad-9eb5-5e88dd4ea25c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:40.918651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2c8a-edc0-42ad-9eb5-5e88dd4ea25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:40.938100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-dd7e2c8a-edc0-42ad-9eb5-5e88dd4ea25c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:40.939329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-dd7e2c8a-edc0-42ad-9eb5-5e88dd4ea25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:40.947126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1181/2319] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:40.962493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:40.975632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9a53c-50fc-4681-9aa5-e7d4b3f040c8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:40.981079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:40.981676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:40.981959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:40.982233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:40.990863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:40.992469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:41.001934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1139/2320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:45.249894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33dbe-d56a-4fdc-b350-274e0fb57c63 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:45.250458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33dbe-d56a-4fdc-b350-274e0fb57c63 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:45.250458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33dbe-d56a-4fdc-b350-274e0fb57c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:45.271924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e3c33dbe-d56a-4fdc-b350-274e0fb57c63 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:45.273141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e3c33dbe-d56a-4fdc-b350-274e0fb57c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:45.281740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1182/2321] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:45.299877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:45.311847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322bc0-169f-40d0-bdd7-615765a3cf0e service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:45.319430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:45.320202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:45.320584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:45.321073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:45.330376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:45.332033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:45.343571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1140/2322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:49.352396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413159-b886-4de2-9cff-4724742d14d5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:49.352928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413159-b886-4de2-9cff-4724742d14d5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:49.352928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413159-b886-4de2-9cff-4724742d14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:49.376123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-31413159-b886-4de2-9cff-4724742d14d5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:49.377350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-31413159-b886-4de2-9cff-4724742d14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:49.387053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1183/2323] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:49.408171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:49.422163 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06b41-454e-439a-940e-58a477118368 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:49.428517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:49.429131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:49.429419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:49.429696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:49.439020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:49.440665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ead2-211f-4904-a9be-275f51524c2d service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:49.450789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1141/2324] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:51.318487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:51.318487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:51.318971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:51.339740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] MFA Rules not processed for user `6e92282873df4a6fa7511c6c4cdab140`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:51.341052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:51.399021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1184/2325] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:52.526263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fb58-b95b-4583-96c4-cd84faf0e518 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:52.526763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fb58-b95b-4583-96c4-cd84faf0e518 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:52.526877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fb58-b95b-4583-96c4-cd84faf0e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:52.546778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-9a94fb58-b95b-4583-96c4-cd84faf0e518 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:52.548052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9a94fb58-b95b-4583-96c4-cd84faf0e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:52.557233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1142/2326] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:52.573925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:52.601945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4143f-075d-44e7-884a-54258072c083 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:52.609585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:52.610388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:52.610685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:52.610935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:52.626040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:52.627944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:52.639752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1185/2327] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:55.760859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7bcd-8fb5-4d1b-a3f7-c175ef1095b2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:55.761356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7bcd-8fb5-4d1b-a3f7-c175ef1095b2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:55.761485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7bcd-8fb5-4d1b-a3f7-c175ef1095b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:55.782106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1e0c7bcd-8fb5-4d1b-a3f7-c175ef1095b2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:20:55.784384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1e0c7bcd-8fb5-4d1b-a3f7-c175ef1095b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:20:55.793080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1143/2328] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:20:55.807792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:20:55.820799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64229-5a81-48c7-a841-b586f7061ea4 service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:20:55.827126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:20:55.827762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:20:55.828046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:20:55.828318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:20:55.842971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:20:55.844616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0840d9-db9e-41fa-8dcb-62ee41d5af97 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:20:55.858596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1186/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:21:05.776020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=24 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:05.851424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=46 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:14.558643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:14.559212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:14.559212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:14.578410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] MFA Rules not processed for user `52868903541b4b7fb4ee6575de2a6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:21:14.579649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:14.587522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1144/2330] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:21:16.478626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:16.479207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:16.479207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:16.498804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] MFA Rules not processed for user `7acceb819010462cb3a887d9661e4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:21:16.499990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:16.507552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1187/2331] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:21:24.573112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:26.494081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:28.714727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:28.727657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea4d9f-0f3d-4a32-9fbd-59769e9a3a73 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:28.732216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:28.732862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:28.733150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:28.733431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] PATH_INFO: `/v3/users/e4c10fea9c83477e9dd027f2f4db0e98` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:28.734601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c10fea9c83477e9dd027f2f4db0e98)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:28.736545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:28.782785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c10fea9c83477e9dd027f2f4db0e98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:28.794998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c10fea9c83477e9dd027f2f4db0e98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:28.801701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c10fea9c83477e9dd027f2f4db0e98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:28.808962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c10fea9c83477e9dd027f2f4db0e98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:28.809580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c10fea9c83477e9dd027f2f4db0e98'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:28.815391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1145/2332] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:21:28 2022] DELETE /identity/v3/users/e4c10fea9c83477e9dd027f2f4db0e98 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:21:29.078220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:29.092257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f2a7-1676-42e2-9339-a048027443e1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:29.153823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:29.154555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:29.154927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:29.155295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] PATH_INFO: `/v3/projects/52b16f7ba78a400d917a17a3822ccc2c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:29.156495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b16f7ba78a400d917a17a3822ccc2c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:29.158562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:29.205207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b16f7ba78a400d917a17a3822ccc2c', 'request_id': 'req-64da7dd2-9257-413b-a4d0-073949522c20'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:29.212445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b16f7ba78a400d917a17a3822ccc2c', 'request_id': 'req-64da7dd2-9257-413b-a4d0-073949522c20'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:29.218649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b16f7ba78a400d917a17a3822ccc2c', 'request_id': 'req-64da7dd2-9257-413b-a4d0-073949522c20'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:29.230736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] The token cache is being invalidate because project 52b16f7ba78a400d917a17a3822ccc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:21:29.231055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:29.231697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-64da7dd2-9257-413b-a4d0-073949522c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:29.233190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1188/2333] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:21:29 2022] DELETE /identity/v3/projects/52b16f7ba78a400d917a17a3822ccc2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:21:31.316382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:31.318958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:31.380178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea76c-3a87-4740-b9a3-d4ac706f5065 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:31.429084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:31.430258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:31.430258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:31.430576 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:31.432590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:31.493223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:31.533942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:31.536477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:31.551540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1146/2334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:21:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:21:32.722056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:32.722498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:32.722594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:32.742531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:21:32.743845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:32.798362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1189/2335] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:21:32.844639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:32.846035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:32.914885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef6e4-18fa-4871-9424-328f41a282d0 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:32.920138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:32.920779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:32.921058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:32.921332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:32.931472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:32.933154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:32.941474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1147/2336] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:21:35.605360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:35.606967 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:35.619866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767ff5b-60e1-4798-84dc-ba08fc1f3fcf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:35.623975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:35.624586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:35.624873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:35.625150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:35.626906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:35.641610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:35.643178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:35.655532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1190/2337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:21:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:21:40.108822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:40.111355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:40.183826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084b37-be4d-48bc-b605-11495f7e97d4 service swift] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:40.188415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:40.189050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:40.189329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:40.189654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] PATH_INFO: `/v3/users/03c92de4b0bf4f0389c20903ff8ebfba` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:40.190774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c92de4b0bf4f0389c20903ff8ebfba)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:40.193688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:40.252128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c92de4b0bf4f0389c20903ff8ebfba'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.263471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:40.265824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c92de4b0bf4f0389c20903ff8ebfba'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.275286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c92de4b0bf4f0389c20903ff8ebfba'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.284905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c92de4b0bf4f0389c20903ff8ebfba'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.285722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c92de4b0bf4f0389c20903ff8ebfba'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.293555 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1148/2338] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:21:40 2022] DELETE /identity/v3/users/03c92de4b0bf4f0389c20903ff8ebfba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:21:40.498695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:40.513576 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b2b8-e0f4-44c7-a58c-3045ffc29854 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:40.533874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:40.575703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:40.576338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:40.576629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:40.576908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] PATH_INFO: `/v3/projects/f02f571213004ddba1b10de540981fe5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:40.578036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02f571213004ddba1b10de540981fe5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:40.579995 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:40.632711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02f571213004ddba1b10de540981fe5', 'request_id': 'req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.641590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02f571213004ddba1b10de540981fe5', 'request_id': 'req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.648776 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02f571213004ddba1b10de540981fe5', 'request_id': 'req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.662069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] The token cache is being invalidate because project f02f571213004ddba1b10de540981fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:21:40.662365 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.663059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.664557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1191/2339] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:21:40 2022] DELETE /identity/v3/projects/f02f571213004ddba1b10de540981fe5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:21:40.668747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:40.670190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:40.684307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aecea-48c5-4f63-afdf-4616edffa4cc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:40.744285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:40.744921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:40.745206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:40.745510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] PATH_INFO: `/v3/users/515f2c309ebf4f058361d3263d2641f1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:40.747305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515f2c309ebf4f058361d3263d2641f1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:40.749950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:40.798463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515f2c309ebf4f058361d3263d2641f1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.810566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515f2c309ebf4f058361d3263d2641f1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.817320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515f2c309ebf4f058361d3263d2641f1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.824703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515f2c309ebf4f058361d3263d2641f1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.825322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515f2c309ebf4f058361d3263d2641f1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:40.831059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1149/2340] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:21:40 2022] DELETE /identity/v3/users/515f2c309ebf4f058361d3263d2641f1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:21:41.017182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:41.018966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:41.035083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc770ae-70b8-4dcd-8fe3-c90fe0700be5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:41.094848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:41.095514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:41.095799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:41.096075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] PATH_INFO: `/v3/projects/a65ecbe3ec364f0f90efb64e0818e663` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:41.097209 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65ecbe3ec364f0f90efb64e0818e663)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:41.099861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:41.147504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65ecbe3ec364f0f90efb64e0818e663', 'request_id': 'req-f86c66a5-2888-4d07-bf75-cb6d7a74f575'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:41.151090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:41.155344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65ecbe3ec364f0f90efb64e0818e663', 'request_id': 'req-f86c66a5-2888-4d07-bf75-cb6d7a74f575'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:41.164045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65ecbe3ec364f0f90efb64e0818e663', 'request_id': 'req-f86c66a5-2888-4d07-bf75-cb6d7a74f575'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:41.174435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] The token cache is being invalidate because project a65ecbe3ec364f0f90efb64e0818e663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:21:41.174725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:41.175377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:21:41.176864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1192/2341] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:21:41 2022] DELETE /identity/v3/projects/a65ecbe3ec364f0f90efb64e0818e663 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:21:44.112384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:44.113811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:44.170910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:44.191004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fdb78-c0a9-411e-9617-8975d9806733 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:44.252777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:44.253400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:44.253682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:44.253954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:44.255899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:44.311893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:44.313493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8106c4-67e0-4fb9-8ee3-f074f4e96b2c service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:44.322431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1150/2342] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:21:51.171494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:54.318331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=58 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:54.411315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:21:54.412783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:54.429902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c66a5-2888-4d07-bf75-cb6d7a74f575 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:21:54.435378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:21:54.435977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:21:54.436258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:21:54.436533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:21:54.438219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:21:54.496217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:21:54.497816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:21:54.513208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1193/2343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:21:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:01.308273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:01.308981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:01.308981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:01.330131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:01.331700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:01.396930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1151/2344] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:22:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:01.409587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:01.411157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:01.486664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de474a0-8bfe-4964-b6e5-8c93315d2bee service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:01.494051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:01.494966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:01.495231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:01.495555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:01.506200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:01.508841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:01.526135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1194/2345] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:10.868984 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:10.870801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:10.892202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fab992-738b-4a3d-9748-36208236c0b5 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:10.899627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:10.900684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:10.901197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:10.901693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:10.904134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:10.918839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:10.920995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:10.933152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1152/2346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:11.522212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=60 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:13.548745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:13.550193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:13.605811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f1e0-49fc-475c-a78c-e2696a7c7829 service swift] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:13.609404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:13.609997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:13.610271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:13.610543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:13.612263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:13.621717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:13.623170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:13.630888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1195/2347] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:14.913591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:14.925775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934c8e0-de99-454a-88cc-acfdeb793fef service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:14.931637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:14.932074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:14.932357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:14.932661 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:14.934391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:14.993000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:14.994583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:15.003867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1153/2348] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:17.651101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:17.669064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9b4d-cfe9-4ef5-8bca-8597877e566f service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:17.685125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:17.685898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:17.686248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:17.686580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:17.690462 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:17.710574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:17.713143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381108-07d1-4530-8bd6-cfa0ca924166 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:17.726856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1196/2349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:21.117068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:21.128395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692dfca-4e5a-47f0-bf99-737a683e6985 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:21.132089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:21.132757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.133047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.133316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.135620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.146853 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:21.148362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860056-4a74-4dc4-bec1-28273aa130ce service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:21.157368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1154/2350] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:21.296922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.297485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.297485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.299709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1197/2351] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:22:21.306702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78f8e-d185-4a34-ba0d-c7c6d49bb72d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.307335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78f8e-d185-4a34-ba0d-c7c6d49bb72d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.307681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78f8e-d185-4a34-ba0d-c7c6d49bb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.332602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c1f78f8e-d185-4a34-ba0d-c7c6d49bb72d None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:21.333967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c1f78f8e-d185-4a34-ba0d-c7c6d49bb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.345416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1155/2352] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:22:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:21.358946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:21.360870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.437704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdcdfb-e36d-40c8-9f76-3a3c9bb51e75 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:21.449997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25211db01b88403c8e4c9479ea9333c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:21.450621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.450902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.451328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.462076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:21.464088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9151cb-085d-4a49-8f05-8d111e3b874e service glance] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:21.475212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1198/2353] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:21.545934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be32f-cbc2-41a5-845e-4f4330f0ed17 None None] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.546282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be32f-cbc2-41a5-845e-4f4330f0ed17 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.546883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be32f-cbc2-41a5-845e-4f4330f0ed17 None None] PATH_INFO: `/` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.548296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1156/2354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:22:21.554092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4014f52-65d0-48d7-8c24-507afb5232a4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.554449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4014f52-65d0-48d7-8c24-507afb5232a4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.554791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4014f52-65d0-48d7-8c24-507afb5232a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.575450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a4014f52-65d0-48d7-8c24-507afb5232a4 None None] MFA Rules not processed for user `183c8b4ac78f42678d68527a0c6e09ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:21.576806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a4014f52-65d0-48d7-8c24-507afb5232a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.583938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1199/2355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:22:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:21.625215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059be32f-cbc2-41a5-845e-4f4330f0ed17 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:21.637056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059be32f-cbc2-41a5-845e-4f4330f0ed17 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:21.640978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:21.641760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.642229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.642664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.653270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:21.654691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2fb41-0f45-46af-a842-397ebf487812 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:21.662883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1157/2356] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:21.792650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.793062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.793348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] PATH_INFO: `/` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.802142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1200/2357] 10.222.0.30 () {54 vars in 921 bytes} [Tue Aug 30 16:22:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 16:22:21.810818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.811313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.811615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.839967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] MFA Rules not processed for user `aa2fa4b0a3974d0e9b04726511427631`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:21.841113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.852357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1158/2358] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Aug 30 16:22:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:21.865228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:21.867047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:21.885444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d62c2-cfe7-4b3e-8bfb-44fb225df025 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:21.890381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:21.890381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:21.890381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:21.890381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:21.901680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:21.903185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:21.914858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1201/2359] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:21.982262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:21.983729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:22.043371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:22.064455 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f950ec-90cf-4242-a99e-5090d8dfdb7a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:22.070102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:22.070818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:22.071196 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:22.071597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:22.073698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:22.087714 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:22.089660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:22.102266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1159/2360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:24.762930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:24.772049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6bd3-4088-49f8-97bc-db767f4beab6 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:24.785383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:24.786510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:24.787008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:24.788197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:24.791113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:24.877803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:24.879490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca5e5-5223-4edf-8e3d-60ceb74f5cfd service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:24.891704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1202/2361] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:25.699887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:25.701644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:25.718447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559044a0-8de3-4133-b571-8a9e26fc6ac7 service placement] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:25.728841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:25.729804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:25.730360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:25.731476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] PATH_INFO: `/v3/users/52868903541b4b7fb4ee6575de2a6d28` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:25.736702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52868903541b4b7fb4ee6575de2a6d28)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:25.739617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:25.756175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:25.758438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:25.759361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:25.791400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:25.800971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:25.802204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:25.813643 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1203/2362] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:22:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:25.828181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:25.842286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d107c-a059-483a-91d4-f84526aecb1e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:25.854241 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:25.855065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:25.855450 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:25.855828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:25.866044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:25.868616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:25.875525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52868903541b4b7fb4ee6575de2a6d28'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:25.891620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52868903541b4b7fb4ee6575de2a6d28'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:25.892558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1204/2363] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:22:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:22:25.903808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52868903541b4b7fb4ee6575de2a6d28'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:25.913198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52868903541b4b7fb4ee6575de2a6d28'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:25.914872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-11151929-a3bb-4a8e-8141-4023c9761725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52868903541b4b7fb4ee6575de2a6d28'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:25.927156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1160/2364] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:25 2022] DELETE /identity/v3/users/52868903541b4b7fb4ee6575de2a6d28 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:26.337931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:26.356982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e61696-e0c2-4e96-92d3-a9ae3e614c90 service swift] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:26.587706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:26.591455 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:26.597077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:26.598430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] PATH_INFO: `/v3/projects/c194259a9aba4ecf8c33ffa64b078239` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:26.608680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c194259a9aba4ecf8c33ffa64b078239)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:26.622214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:26.745177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c194259a9aba4ecf8c33ffa64b078239', 'request_id': 'req-acc3cb42-85ca-42f9-84d1-39a2e44f012f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:26.761061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c194259a9aba4ecf8c33ffa64b078239', 'request_id': 'req-acc3cb42-85ca-42f9-84d1-39a2e44f012f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:26.778622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c194259a9aba4ecf8c33ffa64b078239', 'request_id': 'req-acc3cb42-85ca-42f9-84d1-39a2e44f012f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:26.801924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] The token cache is being invalidate because project c194259a9aba4ecf8c33ffa64b078239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:26.801924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:26.802614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-acc3cb42-85ca-42f9-84d1-39a2e44f012f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:26.806390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1205/2365] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:26 2022] DELETE /identity/v3/projects/c194259a9aba4ecf8c33ffa64b078239 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:26.812904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:26.813873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:26.814693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:26.886359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:26.888948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:27.091036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1161/2366] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:27.098777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.099655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.100202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.132590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:27.134864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:27.157894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1206/2367] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:27.161624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.178111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b71f5-db36-4cf4-93a6-91d2372b9e9a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.189070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.190039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.190458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.191025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.192006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:27.192490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.195061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.215738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1162/2368] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:27.218432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.239549 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131552-5f36-42dc-bcba-93a8b390a2a3 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.247300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.248256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.248523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.248805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.249717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.252374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.299867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1207/2369] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:27 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:27.301243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.313909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43b0f-a2f0-413a-b269-ce95c5e39e5c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.375581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:27.399994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.401122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.401614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.401921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.402790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.405121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.448630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1163/2370] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:27 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:27.452959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.469700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e0424-9823-47d7-807d-023a7d50bb7c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.481122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.481903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.482936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.483352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.486449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.490063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.507181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1208/2371] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:27.511618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.526521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5cdea-c80b-4644-af15-a79879145c2e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.547291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.548144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.548580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.548987 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.549802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.552721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e788a-0520-4071-af4e-ddad0c1ce89a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.579541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1164/2372] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:27.584372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.605442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10fdf2-93fa-4d35-abb5-028159f021c8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:27.617676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:27.618309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.620449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.621011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] PATH_INFO: `/v3/projects/1d4780f459ce4d3c8e208f5abcf6ff35/users/56b975b1c86a4ac6b595c9aa6233a0a4/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.663723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4780f459ce4d3c8e208f5abcf6ff35, user_id=56b975b1c86a4ac6b595c9aa6233a0a4, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:27.680649 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:27.711615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1209/2373] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:27 2022] PUT /identity/v3/projects/1d4780f459ce4d3c8e208f5abcf6ff35/users/56b975b1c86a4ac6b595c9aa6233a0a4/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:27.724307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:27.725036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:27.725494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:27.770641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] MFA Rules not processed for user `56b975b1c86a4ac6b595c9aa6233a0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:27.772838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:27.906051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1165/2374] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:27.912124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:27.938173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.051860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35046-7213-4ea9-b0aa-5cf88f3d69e3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.064763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.065404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.065691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.065973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.066623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.070128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.134193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1210/2375] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:27 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:28.135349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:28.152916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763593-3b8b-440b-9d23-01c1e9532446 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.334093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.335452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.335960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.351395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.352216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.355190 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.416091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:28.417368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1166/2376] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:28 2022] POST /identity/v3/users => generated 309 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:28.443318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba8845-1828-4365-89ec-479b06fde451 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.471020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.471655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.471942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.472238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.472886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.479434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.528043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1211/2377] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:28.532270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:28.549768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9685e9-2dc3-4cc8-8296-737c1a92bd4a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.562058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.562862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.563180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.563590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] PATH_INFO: `/v3/projects/d73461c3388b415bad64a0377fddc9de/users/23a2ebcbb2294017b8dc1ea6f5ed03a2/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.610727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73461c3388b415bad64a0377fddc9de, user_id=23a2ebcbb2294017b8dc1ea6f5ed03a2, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.610727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.640483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1167/2378] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:28 2022] PUT /identity/v3/projects/d73461c3388b415bad64a0377fddc9de/users/23a2ebcbb2294017b8dc1ea6f5ed03a2/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:28.652289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:28.675568 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b680a8-5537-4f64-ab7a-90bec3535957 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.817098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.817745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.818056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.818312 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.818992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.820705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a376b96-9d3b-45ff-b790-7dcd7d1ae860 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.858644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1212/2379] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:28.863081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:28.876989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2713-421b-43da-953b-a1ae0ca89250 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:28.882061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:28.882818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.883218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.883425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] PATH_INFO: `/v3/projects/d73461c3388b415bad64a0377fddc9de/users/23a2ebcbb2294017b8dc1ea6f5ed03a2/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.885737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73461c3388b415bad64a0377fddc9de, user_id=23a2ebcbb2294017b8dc1ea6f5ed03a2, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:28.888771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:28.903089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.912183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1168/2380] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:28 2022] PUT /identity/v3/projects/d73461c3388b415bad64a0377fddc9de/users/23a2ebcbb2294017b8dc1ea6f5ed03a2/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:28.923376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:28.924006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:28.924006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:28.957149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] MFA Rules not processed for user `23a2ebcbb2294017b8dc1ea6f5ed03a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:28.958457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:29.088552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:29.090858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:29.092215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1213/2381] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:29.200296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c516ab-410d-45c3-93e7-adcee9d4dbdf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:29.213560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:29.214372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:29.214782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:29.215174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:29.233973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:29.238078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544db6a-f50c-458e-90d0-e7d0126bbb2e service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:29.281982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1169/2382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:29.527343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:29.561997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:29.682351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81625-7b73-4065-aada-45af7f02cdfb None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:29.693855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:29.694895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:29.695436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:29.695907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] PATH_INFO: `/v3/users/56b975b1c86a4ac6b595c9aa6233a0a4` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:29.698140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b975b1c86a4ac6b595c9aa6233a0a4)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:29.700743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:29.910925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b975b1c86a4ac6b595c9aa6233a0a4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:29.946777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b975b1c86a4ac6b595c9aa6233a0a4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:29.989478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b975b1c86a4ac6b595c9aa6233a0a4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:29.990612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b975b1c86a4ac6b595c9aa6233a0a4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:30.046120 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b975b1c86a4ac6b595c9aa6233a0a4'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:30.075150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1214/2383] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:29 2022] DELETE /identity/v3/users/56b975b1c86a4ac6b595c9aa6233a0a4 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:30.078157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:30.079145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:30.079145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:30.107452 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:30.108688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:30.221953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1170/2384] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:30.234420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:30.237154 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:30.373110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b571584-8a8f-4e50-9164-dc7aad04ebf7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:30.379286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:30.380159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:30.380641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:30.381016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:30.412206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:30.417482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:30.433034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1215/2385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:31.203877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:31.207677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.256534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3e37f-3884-4fc8-9d8f-58dc4a82d556 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:31.262042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:31.263550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.283175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:31.284057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:31.284518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:31.284962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] PATH_INFO: `/v3/users/6e92282873df4a6fa7511c6c4cdab140` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:31.286315 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e92282873df4a6fa7511c6c4cdab140)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:31.289204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:31.313623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be17a1-2886-4bee-b30e-22de0587a025 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:31.320852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:31.323960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:31.324841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:31.325475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] PATH_INFO: `/v3/projects/1d4780f459ce4d3c8e208f5abcf6ff35` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:31.327414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4780f459ce4d3c8e208f5abcf6ff35)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:31.329950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:31.390006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:31.403242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e92282873df4a6fa7511c6c4cdab140'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.419732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4780f459ce4d3c8e208f5abcf6ff35', 'request_id': 'req-c52baa9f-7b5b-4f25-8054-df5d2c351a53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.422501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e92282873df4a6fa7511c6c4cdab140'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.431453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4780f459ce4d3c8e208f5abcf6ff35', 'request_id': 'req-c52baa9f-7b5b-4f25-8054-df5d2c351a53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.432391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e92282873df4a6fa7511c6c4cdab140'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.443063 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e92282873df4a6fa7511c6c4cdab140'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.444077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e92282873df4a6fa7511c6c4cdab140'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.444785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4780f459ce4d3c8e208f5abcf6ff35', 'request_id': 'req-c52baa9f-7b5b-4f25-8054-df5d2c351a53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.452470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1171/2386] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:31 2022] DELETE /identity/v3/users/6e92282873df4a6fa7511c6c4cdab140 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:31.453643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:31.455233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.468896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] The token cache is being invalidate because project 1d4780f459ce4d3c8e208f5abcf6ff35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:31.469659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.470683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.475627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1216/2387] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:31 2022] DELETE /identity/v3/projects/1d4780f459ce4d3c8e208f5abcf6ff35 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:31.477112 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:31.479178 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.535918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:31.574143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52baa9f-7b5b-4f25-8054-df5d2c351a53 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:31.689298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d55ab-c37a-477b-8a72-6d0f09579475 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:31.702431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:31.703201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:31.706025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:31.706465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:31.708935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.719218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:31.722584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:31.722901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:31.723277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] PATH_INFO: `/v3/users/23a2ebcbb2294017b8dc1ea6f5ed03a2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:31.727999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a2ebcbb2294017b8dc1ea6f5ed03a2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:31.733772 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:31.743622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:31.748869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:31.777656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1172/2388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:31.874850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a2ebcbb2294017b8dc1ea6f5ed03a2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.886606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a2ebcbb2294017b8dc1ea6f5ed03a2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.906387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a2ebcbb2294017b8dc1ea6f5ed03a2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.907256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a2ebcbb2294017b8dc1ea6f5ed03a2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.908901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:31.915813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:31.917739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:31.939261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7d27-3dbf-4824-9ba1-c50c6e0b139e service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:31.940596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e1ec88b9-dcdc-44eb-9525-67539afc6243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a2ebcbb2294017b8dc1ea6f5ed03a2'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:31.954166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:31.955009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:31.955397 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:31.955782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] PATH_INFO: `/v3/projects/e7545ca26f894f3f86ca66a3ac5cc717` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:31.957425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7545ca26f894f3f86ca66a3ac5cc717)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:31.960067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:31.964194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1217/2389] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:31 2022] DELETE /identity/v3/users/23a2ebcbb2294017b8dc1ea6f5ed03a2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:32.071704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7545ca26f894f3f86ca66a3ac5cc717', 'request_id': 'req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.087634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7545ca26f894f3f86ca66a3ac5cc717', 'request_id': 'req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.097390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7545ca26f894f3f86ca66a3ac5cc717', 'request_id': 'req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.115601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] The token cache is being invalidate because project e7545ca26f894f3f86ca66a3ac5cc717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:32.116205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.117146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1a7ac507-6d6a-48a4-a289-9f155c1b9b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.122840 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1173/2390] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:31 2022] DELETE /identity/v3/projects/e7545ca26f894f3f86ca66a3ac5cc717 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:32.124582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.125129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.125611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.159454 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:32.161010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:32.296921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1218/2391] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:32.305044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.305579 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.305867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.347897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:32.356765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:32.377800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1174/2392] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:32.381874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:32.398166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd073-c23b-4bc6-8dd5-318d0ee56a92 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:32.409478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:32.410115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.410401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.410675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.411369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:32.411677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:32.419648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:32.452012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1219/2393] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:32.456690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:32.472764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7394fd5-a371-499e-ae8c-46a829fb18c5 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:32.490192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:32.490837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.491168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.491545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.492119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:32.507554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:32.531553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:32.533494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:32.574143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1175/2394] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:32 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:32.578234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:32.582409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1f069-f401-4ce5-9d46-adcb617a067b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:32.717175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:32.718261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.718811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.719316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] PATH_INFO: `/v3/projects/d73461c3388b415bad64a0377fddc9de` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.720808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73461c3388b415bad64a0377fddc9de)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:32.723300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:32.736807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fccb8-3e1b-4f95-9f13-65ad1f382983 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:32.751013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:32.751634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.751922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.752202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.752859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:32.757689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:32.811109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1176/2395] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:32 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:32.812403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:32.821913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:32.847631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73461c3388b415bad64a0377fddc9de', 'request_id': 'req-d4a16116-09c1-46ee-b92a-c2d050d1ed25'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.847879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194193d-c129-4c70-ae5f-030f282af9de admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:32.862019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73461c3388b415bad64a0377fddc9de', 'request_id': 'req-d4a16116-09c1-46ee-b92a-c2d050d1ed25'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.871326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73461c3388b415bad64a0377fddc9de', 'request_id': 'req-d4a16116-09c1-46ee-b92a-c2d050d1ed25'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.879486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:32.886255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] The token cache is being invalidate because project d73461c3388b415bad64a0377fddc9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:32.886557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.888054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d4a16116-09c1-46ee-b92a-c2d050d1ed25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:32.890274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1220/2396] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:32 2022] DELETE /identity/v3/projects/d73461c3388b415bad64a0377fddc9de => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:32.897282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed82-8dd8-4037-ab3b-26f982314e43 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:32.898084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed82-8dd8-4037-ab3b-26f982314e43 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:32.898667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed82-8dd8-4037-ab3b-26f982314e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:32.941745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8163ed82-8dd8-4037-ab3b-26f982314e43 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:32.944158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8163ed82-8dd8-4037-ab3b-26f982314e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:33.038606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.039224 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.039962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.039962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.040668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.043055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.079698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1221/2397] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:33.084570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1177/2398] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:33.090705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.091247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.091592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.091945 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.097726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:33.131988 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c774d9-fcc8-4166-9310-a4d7dcf8ea56 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.137307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:33.139770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:33.143510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.146954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.147565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.148047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.149230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.151577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.161885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1222/2399] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:33.163032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.175639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1178/2400] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:33.179909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.181609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bef58-c6d4-41fa-8584-0ae61be75dc8 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.194944 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.195477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22394-9990-4379-9008-ba79b8fc6358 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.195641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.195879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.196184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.196989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:33.197300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.205259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.210597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.211592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.212167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.212787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] PATH_INFO: `/v3/projects/c69916ae93394645b610b04e1957189b/users/67af8520b2ea4f55b404dc6b9ef61782/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.238387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1223/2401] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:33.242495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.251022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69916ae93394645b610b04e1957189b, user_id=67af8520b2ea4f55b404dc6b9ef61782, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.261653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556ee35-6355-4fdd-be09-98bb5b88465b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.264929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115037-3296-4a28-a66c-841067f2ba01 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.283049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.283697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.283981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.284262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.284920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.286927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.316013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1179/2402] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:33 2022] PUT /identity/v3/projects/c69916ae93394645b610b04e1957189b/users/67af8520b2ea4f55b404dc6b9ef61782/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:33.332307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.332684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.333022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.383025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1224/2403] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:33 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:33.388233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.395973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] MFA Rules not processed for user `67af8520b2ea4f55b404dc6b9ef61782`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:33.397557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:33.544227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1180/2404] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:33.551668 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.556961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:33.610921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3993b2-f48a-46ce-b8f1-fe16e7574277 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.626645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.627420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.627707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.628085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.628812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.630705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.663893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:33.684822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1225/2405] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:33 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:33.686230 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.714320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38564-db94-4bdc-8215-6bac07b1f076 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.717658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850266ff-f350-4256-bf27-3e736d4f13a2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.732723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.733472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.733603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.733847 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.734193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.734350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.734482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.734755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.736980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.736980 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.753870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.758030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.766148 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1226/2406] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:33.767507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.786286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50665-448d-470d-a967-22b0bf479b33 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.787642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1181/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:33.796886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.797588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.797948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.798299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.799057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.800898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb0c05-2135-4a00-9809-1a476f2edc33 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.817728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1227/2408] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:33.819103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:33.845263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997b1b-8605-4904-8867-040d1a03f7df service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:33.863526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:33.864532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.864919 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.865359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] PATH_INFO: `/v3/projects/25af1256dd9a429787a93cbd4d25813e/users/bba4ee0fd2084cbf9a50d96d74399438/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.909056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25af1256dd9a429787a93cbd4d25813e, user_id=bba4ee0fd2084cbf9a50d96d74399438, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:33.912270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:33.938635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1182/2409] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:33 2022] PUT /identity/v3/projects/25af1256dd9a429787a93cbd4d25813e/users/bba4ee0fd2084cbf9a50d96d74399438/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:33.951294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983327-f223-457e-8574-27771c43723e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:33.951807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983327-f223-457e-8574-27771c43723e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:33.951932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983327-f223-457e-8574-27771c43723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:33.983096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-53983327-f223-457e-8574-27771c43723e None None] MFA Rules not processed for user `bba4ee0fd2084cbf9a50d96d74399438`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:33.984400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-53983327-f223-457e-8574-27771c43723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:34.029491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:34.153533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1228/2410] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:34.158679 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:34.301016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb265d5-245a-4a6b-80bd-df175d073b5a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:34.313366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:34.313999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:34.314286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:34.314561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:34.315247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:34.317963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:34.383565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1183/2411] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:34 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:34.390809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53983327-f223-457e-8574-27771c43723e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:34.416602 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53983327-f223-457e-8574-27771c43723e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:34.662676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:34.664084 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:34.665214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:34.665839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:34.667019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:34.669895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:34.722757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1229/2412] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:34 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:34.726035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:34.743051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541765-0c41-423f-800a-32f437ef9834 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:34.756499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:34.757572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:34.757904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:34.758245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:34.759584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:34.766869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:34.791720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1184/2413] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:34.796122 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:34.815293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092ea8-b11c-42bb-951e-62195c9ed949 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:34.874647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:34.881525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:34.882034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:34.882390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] PATH_INFO: `/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8/users/ae81a28ae6764d088f37e4ff0b0f46cf/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:34.956993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e5301d5f5b417f9b5b91a2e89cb6e8, user_id=ae81a28ae6764d088f37e4ff0b0f46cf, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:34.960211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:34.997439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1230/2414] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:34 2022] PUT /identity/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8/users/ae81a28ae6764d088f37e4ff0b0f46cf/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:35.001823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:35.016540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68cef-786a-4b13-8132-13708fbda111 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:35.148359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:35.151329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:35.152697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:35.154209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:35.157449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:35.162374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f649-9a25-423f-a1b7-3772606c78ac admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:35.196725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1185/2415] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:35.200348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:35.241146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c491-5a8d-41d5-aaa9-930d9f3b9b4a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:35.263778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:35.264757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:35.265228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:35.265719 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] PATH_INFO: `/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8/users/ae81a28ae6764d088f37e4ff0b0f46cf/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:35.274647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e5301d5f5b417f9b5b91a2e89cb6e8, user_id=ae81a28ae6764d088f37e4ff0b0f46cf, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:35.291578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:35.333217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1231/2416] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:35 2022] PUT /identity/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8/users/ae81a28ae6764d088f37e4ff0b0f46cf/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:35.345258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:35.348195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:35.348561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:35.411515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] MFA Rules not processed for user `ae81a28ae6764d088f37e4ff0b0f46cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:35.413211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:35.434066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:35.544228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1186/2417] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:35.556912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:35.559631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:35.627717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a4a51-6242-4de1-9de4-10072ba7fd60 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:35.631292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:35.631894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:35.632175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:35.632441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:35.641905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:35.643338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:35.653441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1232/2418] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:36.903350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:36.905111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:36.977186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292d0c-24ad-4ca5-a27b-e9b9829ac475 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:36.987647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:36.988239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:36.988521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:36.988795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] PATH_INFO: `/v3/users/7acceb819010462cb3a887d9661e4f68` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:36.989948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acceb819010462cb3a887d9661e4f68)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:36.992233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.030218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.039445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2c56-8e5d-46ac-a760-d64cf1071f4c service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.049097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.049789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.050095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.050663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] PATH_INFO: `/v3/users/67af8520b2ea4f55b404dc6b9ef61782` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.052386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67af8520b2ea4f55b404dc6b9ef61782)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.054559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.057916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.068749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acceb819010462cb3a887d9661e4f68'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.081761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acceb819010462cb3a887d9661e4f68'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.091797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acceb819010462cb3a887d9661e4f68'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.101335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acceb819010462cb3a887d9661e4f68'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.102121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-faca8ca3-f091-4720-ba93-84f90fb22e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acceb819010462cb3a887d9661e4f68'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.108799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1187/2419] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:36 2022] DELETE /identity/v3/users/7acceb819010462cb3a887d9661e4f68 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:37.123286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67af8520b2ea4f55b404dc6b9ef61782'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.139516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67af8520b2ea4f55b404dc6b9ef61782'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.148834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67af8520b2ea4f55b404dc6b9ef61782'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.150247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67af8520b2ea4f55b404dc6b9ef61782'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.166956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67af8520b2ea4f55b404dc6b9ef61782'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.173106 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1233/2420] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:37 2022] DELETE /identity/v3/users/67af8520b2ea4f55b404dc6b9ef61782 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:37.177660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917a9a-acfc-483d-aa31-256941441567 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.177957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917a9a-acfc-483d-aa31-256941441567 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.178237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917a9a-acfc-483d-aa31-256941441567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.202294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-91917a9a-acfc-483d-aa31-256941441567 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:37.203557 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-91917a9a-acfc-483d-aa31-256941441567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.232653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.276417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1188/2421] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:37.288470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.290040 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.309337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91917a9a-acfc-483d-aa31-256941441567 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.311453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-91917a9a-acfc-483d-aa31-256941441567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.337289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91917a9a-acfc-483d-aa31-256941441567 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.346945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.348633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.348955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.349204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] PATH_INFO: `/v3/projects/8b36ad37233a4f95a65ef6dc90be2ae2` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.350462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b36ad37233a4f95a65ef6dc90be2ae2)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.352567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.382146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75466f4-0cc5-4e22-8f31-9160e88e7225 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.387320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.388075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.388459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.388753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.401250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.403198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.414638 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1234/2422] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:37.415367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.415797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b36ad37233a4f95a65ef6dc90be2ae2', 'request_id': 'req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.416685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.424464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b36ad37233a4f95a65ef6dc90be2ae2', 'request_id': 'req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.432362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb467-b60d-41a7-930f-4b8f2e9fe2f6 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.435052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b36ad37233a4f95a65ef6dc90be2ae2', 'request_id': 'req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.449355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] The token cache is being invalidate because project 8b36ad37233a4f95a65ef6dc90be2ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:37.449766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.450505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-bb4a1809-73f9-4df1-ade5-bfcf7380bd6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.455325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1189/2423] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:37 2022] DELETE /identity/v3/projects/8b36ad37233a4f95a65ef6dc90be2ae2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:37.458064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521091-568a-4f53-a9de-f50136ab4c72 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.458418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521091-568a-4f53-a9de-f50136ab4c72 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.458763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521091-568a-4f53-a9de-f50136ab4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.482241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a1521091-568a-4f53-a9de-f50136ab4c72 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:37.483632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a1521091-568a-4f53-a9de-f50136ab4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.503741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.504912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.505284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.505673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] PATH_INFO: `/v3/users/bba4ee0fd2084cbf9a50d96d74399438` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.507337 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba4ee0fd2084cbf9a50d96d74399438)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.510303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.541781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.560734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1190/2424] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:37.568559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.568917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.569258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.583201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba4ee0fd2084cbf9a50d96d74399438'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.591422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba4ee0fd2084cbf9a50d96d74399438'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.597281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:37.599087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.600792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba4ee0fd2084cbf9a50d96d74399438'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.601860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba4ee0fd2084cbf9a50d96d74399438'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.610037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1191/2425] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:37.614213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.617268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9bf0a194-382c-4c8e-99dd-fc8e9bd52c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba4ee0fd2084cbf9a50d96d74399438'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.625765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a784-8238-40c5-972d-76da6698ece8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.625962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1235/2426] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:37 2022] DELETE /identity/v3/users/bba4ee0fd2084cbf9a50d96d74399438 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:37.631198 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.631922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.632359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.655997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:37.657015 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.707192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.729355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.729986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.730268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.730719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.731486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:37.731799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.733525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.750468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1192/2427] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:22:37.750468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.750875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1236/2428] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:37.751594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.751831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.766034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac2720-dd9c-4f93-9f75-fb07e161f90f None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.766646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cd304-41e9-425a-b21e-ee68d16e7648 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.773046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.773838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.774190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.774463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.775133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.776665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.777066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.777313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.777598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.777881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] PATH_INFO: `/v3/projects/c69916ae93394645b610b04e1957189b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.779256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69916ae93394645b610b04e1957189b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.781986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.826343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1237/2429] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:37.827534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.829350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.853655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69916ae93394645b610b04e1957189b', 'request_id': 'req-26522536-90df-4b8e-a49c-47824bc81d23'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.869503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69916ae93394645b610b04e1957189b', 'request_id': 'req-26522536-90df-4b8e-a49c-47824bc81d23'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.876429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69916ae93394645b610b04e1957189b', 'request_id': 'req-26522536-90df-4b8e-a49c-47824bc81d23'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.889249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] The token cache is being invalidate because project c69916ae93394645b610b04e1957189b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:37.889653 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.890349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:37.891960 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1193/2430] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:37 2022] DELETE /identity/v3/projects/c69916ae93394645b610b04e1957189b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:37.892864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:37.894878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.898584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937759-ee8a-40de-8932-a3e4999033a7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.934105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.952563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.953179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.953463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.953741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.955544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:37.959131 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522536-90df-4b8e-a49c-47824bc81d23 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:37.964362 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:37.964963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.965242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.965514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.966138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.968087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.968605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:37.970050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26ea09-a6d5-4dcb-a4e2-2d275bb2bc85 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:37.979920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1238/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:37.981137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf2c7-579c-4e3b-9bd3-f80a29967011 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:37.981428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf2c7-579c-4e3b-9bd3-f80a29967011 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:37.981774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf2c7-579c-4e3b-9bd3-f80a29967011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:37.997176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1194/2432] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.002626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.003093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3d2cf2c7-579c-4e3b-9bd3-f80a29967011 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:38.004331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3d2cf2c7-579c-4e3b-9bd3-f80a29967011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.013796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1239/2433] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:38.013977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8879-f6f7-47f7-9802-aa88ce2c5398 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.019268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.019884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.020238 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.020573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.021427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.022605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.022947 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.023204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.023314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.035174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1195/2434] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:38.039096 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.043614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:38.044840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.049670 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9cbe6-ec5d-4897-9784-62d2a9afb27b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.055889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.056504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.056789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.057161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.057575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1240/2435] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:38.058221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.058465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.060277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.067823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467c43c-2344-4d8a-a483-0beb10a975d8 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.074579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.074802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.075091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.075372 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.076026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:38.076160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1196/2436] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:38.076332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.077959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.080263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.091275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1241/2437] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:38.091633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05960-44c3-48ea-bb41-6dfec1b487be admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.095483 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.098958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.099724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.100078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.100422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] PATH_INFO: `/v3/projects/bbd55e4bfd704d8a95336b8022bcf2a1/users/b7c25b46e3164afd85f48688d15fab93/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.105544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9783b-75f2-4f7e-bff3-29c3cd59127b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.110526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.111555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.111555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.111801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.112514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.114430 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.118546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd55e4bfd704d8a95336b8022bcf2a1, user_id=b7c25b46e3164afd85f48688d15fab93, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.121824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163f571-017f-4fd0-979b-a8c94dac2e43 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.136937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1197/2438] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:38 2022] PUT /identity/v3/projects/bbd55e4bfd704d8a95336b8022bcf2a1/users/b7c25b46e3164afd85f48688d15fab93/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:38.149202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.149432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.149705 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.163688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:38.165396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1242/2439] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.169739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.182215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] MFA Rules not processed for user `b7c25b46e3164afd85f48688d15fab93`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:38.183745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.249229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad346a6-461a-4509-b427-d495770182d5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.254201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.254879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.255610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.255610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.256213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.259052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.284213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1198/2440] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:38.289657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.293443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1243/2441] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.294533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.296264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.309509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebbb9-f875-4d81-9ba5-5a48a92ca75c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.314420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.315094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.315358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.315679 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] PATH_INFO: `/v3/projects/25af1256dd9a429787a93cbd4d25813e` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.316839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=25af1256dd9a429787a93cbd4d25813e)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.317588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d258eb-445f-4950-b668-27b035b75167 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.318756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.323929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.324552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.324835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.325108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.325752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.328213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.361622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1199/2442] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.363926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.371811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25af1256dd9a429787a93cbd4d25813e', 'request_id': 'req-545a3d20-f2a2-4924-a90b-379c11637bac'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.379716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25af1256dd9a429787a93cbd4d25813e', 'request_id': 'req-545a3d20-f2a2-4924-a90b-379c11637bac'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.386936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25af1256dd9a429787a93cbd4d25813e', 'request_id': 'req-545a3d20-f2a2-4924-a90b-379c11637bac'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.398673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] The token cache is being invalidate because project 25af1256dd9a429787a93cbd4d25813e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:38.399301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.400046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.401580 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1244/2443] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:38 2022] DELETE /identity/v3/projects/25af1256dd9a429787a93cbd4d25813e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:38.402346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.403731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.410021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:38.428722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73d25-90b7-4662-a200-b7355e9bfe6f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.434203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.434805 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.435124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.435527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.436185 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.437798 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.447815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1200/2444] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:38.448640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.450329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.463687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9bc0-4916-4e72-b72b-c39507a75f9e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.468466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.469073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.469357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.469640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] PATH_INFO: `/v3/users/ae81a28ae6764d088f37e4ff0b0f46cf` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.470775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae81a28ae6764d088f37e4ff0b0f46cf)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.472732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.473375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3d20-f2a2-4924-a90b-379c11637bac admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.479081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.479692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.479976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.480256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.480889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.482816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.505642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1245/2445] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.506551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.508485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.520759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a44b17-96f5-4ad0-aee7-15deb4384ffd admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.523269 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae81a28ae6764d088f37e4ff0b0f46cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.525766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.526355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.526642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.526920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.527589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.529206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.535515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae81a28ae6764d088f37e4ff0b0f46cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.536688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:38.539140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1246/2446] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:38.540555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.544367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae81a28ae6764d088f37e4ff0b0f46cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.551938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae81a28ae6764d088f37e4ff0b0f46cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.552469 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488165-a0eb-4d10-8736-10715e0a67d6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.552727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae81a28ae6764d088f37e4ff0b0f46cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:38.557979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.558611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.558892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.559210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.562491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1201/2447] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:38 2022] DELETE /identity/v3/users/ae81a28ae6764d088f37e4ff0b0f46cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:38.562645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.562747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.562848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.562947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.575137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1247/2448] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:38.578752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.580740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.596806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84b0a-870c-48cd-adda-5d2d0a948ff5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.652528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdece7b-f768-49b3-bdce-583b47a7cabe admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.658784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.659751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.660095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.660380 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] PATH_INFO: `/v3/projects/e2aa923458394c4fa2ade9c8ba0fc284/users/7eccf91e039143f1ba01508a4fdf2ee5/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.681889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2aa923458394c4fa2ade9c8ba0fc284, user_id=7eccf91e039143f1ba01508a4fdf2ee5, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.684514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.685216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d2434-83a8-4f08-864a-40ee15cd6422 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.685528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.686488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.686931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] PATH_INFO: `/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f/users/e8eb677cde004fecbd68ae36d384e721/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.703025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1202/2449] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:38 2022] PUT /identity/v3/projects/e2aa923458394c4fa2ade9c8ba0fc284/users/7eccf91e039143f1ba01508a4fdf2ee5/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:38.714361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.714895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.715386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.720060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3021e9f6b346829fa9a2279e9ea94f, user_id=e8eb677cde004fecbd68ae36d384e721, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.723270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.747842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1248/2450] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:38 2022] PUT /identity/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f/users/e8eb677cde004fecbd68ae36d384e721/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:38.751748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.769322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] MFA Rules not processed for user `7eccf91e039143f1ba01508a4fdf2ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:38.770761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.827667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:38.837644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239819-770a-4d11-9ea1-8947fc200e98 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.844329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.844868 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.845234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.845513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.846908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.849564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.864549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1203/2451] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:38.865275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1249/2452] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:38.869104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.871557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.885393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f9ad-737e-44df-8e89-c2bd2d0f1635 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.891532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.892327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.892698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.893041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] PATH_INFO: `/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f/users/e8eb677cde004fecbd68ae36d384e721/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.896567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3021e9f6b346829fa9a2279e9ea94f, user_id=e8eb677cde004fecbd68ae36d384e721, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.901346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.902171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e67a9f-421d-45dc-a3e9-37e16627f8a6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:38.918807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1204/2453] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:38 2022] PUT /identity/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f/users/e8eb677cde004fecbd68ae36d384e721/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:38.930134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:38.930134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:38.932903 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:38.933642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.934270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.934270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:38.935299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:38.937484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544a796-02b3-4091-9070-28435cd4261f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:38.978078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1250/2454] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:38.984433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:38.984783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:38.985191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.057931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.060257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] MFA Rules not processed for user `e8eb677cde004fecbd68ae36d384e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:39.061500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.090316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977981-a413-4576-ad7b-d17fa00bdd4a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.156253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1251/2455] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:39.157047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.162472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.163162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.163414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.163759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] PATH_INFO: `/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.165367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e5301d5f5b417f9b5b91a2e89cb6e8)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.167497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.220153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e5301d5f5b417f9b5b91a2e89cb6e8', 'request_id': 'req-b0a61c9b-1d98-492f-8e70-114ceb2e65da'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:39.228165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771171f-fb90-4c88-ba3e-331b6ecb62e6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.230319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e5301d5f5b417f9b5b91a2e89cb6e8', 'request_id': 'req-b0a61c9b-1d98-492f-8e70-114ceb2e65da'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:39.237441 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e5301d5f5b417f9b5b91a2e89cb6e8', 'request_id': 'req-b0a61c9b-1d98-492f-8e70-114ceb2e65da'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:39.250041 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] The token cache is being invalidate because project 95e5301d5f5b417f9b5b91a2e89cb6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:39.250335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:39.251029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:39.252535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1205/2456] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:38 2022] DELETE /identity/v3/projects/95e5301d5f5b417f9b5b91a2e89cb6e8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:39.256262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.256262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.287952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.288489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.288805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.289065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.290402 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.292786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d90d8-32fd-4227-8c46-d3bb16391fab admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.301833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.314532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a61c9b-1d98-492f-8e70-114ceb2e65da admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.318809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1252/2457] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:39.318809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.318809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.318809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.321210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.321864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.322153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.322425 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.324390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.340250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:39.341489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.352706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1253/2458] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:39.353533 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.354794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.363990 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.366614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33c67-d629-45a8-b7ce-1c5538583429 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.372955 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.373544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.373830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.374504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.375228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.376900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4236e9-bf2b-4850-bee4-3f1e0ac45458 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.387158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1254/2459] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:39.388422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.388839 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.389095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.394226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.395703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.404975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1206/2460] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:39.405748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.408417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:39.409634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.416839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4abf40-0567-47f4-ab1a-24c23be29ba7 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.418501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1255/2461] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:39.421831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.422488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.422770 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.423150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] PATH_INFO: `/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f/users/4e5244d323b44e9baf3df1294ff70f85/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.423358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.433369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1c06-3025-46e2-810b-1aba6cd94f5a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.438189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.438913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.439420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.439765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.440475 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:39.440861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.441674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f4fd1185ed4088a4568ba0b313f67f, user_id=4e5244d323b44e9baf3df1294ff70f85, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.442684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.444799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.456594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1256/2462] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:22:39.461028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.463889 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1207/2463] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:39 2022] PUT /identity/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f/users/4e5244d323b44e9baf3df1294ff70f85/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:39.467667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.473062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa103-7496-4c73-9628-dbc3ceef868d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.537403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1cb-cb50-49ce-a72c-f1f932ce44d5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.543261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.543989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.544274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.544599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.545252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.545385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.546313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.546592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.546872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.547116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.547578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.550826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.558053 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1208/2464] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:39.562248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.574067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8060b0-6755-4b25-9e38-824f481732cd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.579882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.580596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.580973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.581422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] PATH_INFO: `/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f/users/4e5244d323b44e9baf3df1294ff70f85/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.583721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f4fd1185ed4088a4568ba0b313f67f, user_id=4e5244d323b44e9baf3df1294ff70f85, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.584845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1257/2465] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:39.589066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998fc4-0c02-4a82-9fa1-cfd8f8b6018e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.589261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.602874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1209/2466] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:39 2022] PUT /identity/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f/users/4e5244d323b44e9baf3df1294ff70f85/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:39.613532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.613804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.614078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.645791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] MFA Rules not processed for user `4e5244d323b44e9baf3df1294ff70f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:39.647113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:39.659737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7005da-dff9-4a61-941c-c06b46a88227 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.722714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.751734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1210/2467] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:39.752865 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.753586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.753934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.754269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.755022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.757007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.765651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.780546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1258/2468] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:39.785386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.792667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.804380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c24de-ec04-40bf-9949-2cac6a52a8a4 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.809942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.810550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.810832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.811159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.811806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.813418 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.825029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1259/2469] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:39.829261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.833447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65f98e-34b9-409c-8ee5-0d44c981e2ba None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.838812 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.839458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.839739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.840015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.841709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8013460-f6a8-40cc-abff-4ae0b7eddacf admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.846737 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.847747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.848103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.848378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.849022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.849920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.850783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334631-0feb-4288-a4c3-3a7f95b9e199 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.851594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.862518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1211/2470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:39.866165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1260/2471] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:39.871159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.882255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110087-7b37-4d7e-a59d-2665c767d04c service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:39.889124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:39.889803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.890797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.891124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] PATH_INFO: `/v3/projects/57aaf39985e244a9a70a4cd0d1a8e68a/users/6d166871280d49508910bd80dc0bbd81/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.908326 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aaf39985e244a9a70a4cd0d1a8e68a, user_id=6d166871280d49508910bd80dc0bbd81, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:39.912301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:39.928866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1212/2472] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:39 2022] PUT /identity/v3/projects/57aaf39985e244a9a70a4cd0d1a8e68a/users/6d166871280d49508910bd80dc0bbd81/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:39.939928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:39.940218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:39.940493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:39.944092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:39.971701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] MFA Rules not processed for user `6d166871280d49508910bd80dc0bbd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:39.972933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.003030 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063354-d49a-44d1-9553-43d5cbd75ccc admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.006645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.007294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.007586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.007848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.010517 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.044344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1261/2473] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:40.048824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.072494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.073906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.083534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1213/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:40.111764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440ab11-6b7d-4b19-9add-896b729aacb2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.116590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.117392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.117703 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.117977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.118722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.120970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.154362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1262/2475] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:40 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:40.155390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.170787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebeff9-32d5-4d15-9910-f10bdb8127e9 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.276360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:40.289052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.290580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.291123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.291650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.292281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.294205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.317630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1214/2476] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:40 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:40.321780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.335663 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924d81-5c79-467b-bf66-3e8e9e389634 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.342105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.342829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.343164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.343479 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.344174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.346098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.357370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1263/2477] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:40.361518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.371875 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239589d1-db7f-44f6-a4bc-07dae355fe6a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.376414 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.377050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.377327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.377598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] PATH_INFO: `/v3/projects/ea9d0f0d428245108e043af53621f0d6/users/4af17b4090b042818ca5dfd6736e7117/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.392203 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9d0f0d428245108e043af53621f0d6, user_id=4af17b4090b042818ca5dfd6736e7117, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.394831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.407505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1215/2478] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:40 2022] PUT /identity/v3/projects/ea9d0f0d428245108e043af53621f0d6/users/4af17b4090b042818ca5dfd6736e7117/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:40.411371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.422193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9322445-6c16-4de9-a24a-afe513fe2f50 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.436172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:40.485274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.485900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.486183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.486460 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.487149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.488830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e50ac-ab85-4bb9-bedb-e041d7e866b0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.501849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1264/2479] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:40.507954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.518604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff103-7a4c-4d68-be40-6c2318842411 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.525844 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.527751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.528029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.528533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] PATH_INFO: `/v3/projects/ea9d0f0d428245108e043af53621f0d6/users/4af17b4090b042818ca5dfd6736e7117/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.533043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9d0f0d428245108e043af53621f0d6, user_id=4af17b4090b042818ca5dfd6736e7117, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.536044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.564430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1216/2480] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:40 2022] PUT /identity/v3/projects/ea9d0f0d428245108e043af53621f0d6/users/4af17b4090b042818ca5dfd6736e7117/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:40.576768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509bd62-9190-4228-8162-a4248d39285c None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.576989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509bd62-9190-4228-8162-a4248d39285c None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.577265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509bd62-9190-4228-8162-a4248d39285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.606250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2509bd62-9190-4228-8162-a4248d39285c None None] MFA Rules not processed for user `4af17b4090b042818ca5dfd6736e7117`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:40.607494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2509bd62-9190-4228-8162-a4248d39285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.680805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1265/2481] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:40.689241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.754692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece001a-8367-45e5-974e-783e5e54d026 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.759978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.760594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.760872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.761144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.771319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.772762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.784408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1217/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:40.824082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509bd62-9190-4228-8162-a4248d39285c None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.825676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2509bd62-9190-4228-8162-a4248d39285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.827403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.829217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.845472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a6e2-16b8-477f-bbc1-ff462301ccef service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.849553 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.850422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.850874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.852516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.854708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.917027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509bd62-9190-4228-8162-a4248d39285c None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.922657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.923689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.924183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.924672 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.925158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.926596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.928041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:40.938094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1218/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:40.939023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:40.945023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:40.946665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bb8bc-0f49-4877-8347-0a246c7a79a0 service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:40.947434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e056-7e7b-4960-aaaf-79b0215abbac service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:40.952713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:40.953434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:40.953839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:40.954246 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:40.957825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1266/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:41.001937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:41.024721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:41.026810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:41.038761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1219/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:42.233554 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:42.234045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:42.234413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:42.255589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:42.256939 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:42.277060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:42.314989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1267/2486] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:42.338570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:42.340319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:42.421492 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1125-9307-46f1-85b7-86549f6fdc48 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:42.428140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:42.428951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:42.429319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:42.429716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:42.445720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:42.447403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eaca3-2140-4f60-85c8-b6871ae9c758 service swift] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:42.458219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1220/2487] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:22:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:44.535085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:44.603516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc7e1a-b552-4c69-8b2f-b2981352a4e1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:44.608164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:44.608787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:44.609070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:44.609350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] PATH_INFO: `/v3/users/6d166871280d49508910bd80dc0bbd81` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:44.610493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d166871280d49508910bd80dc0bbd81)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:44.612527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:44.658407 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d166871280d49508910bd80dc0bbd81'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.666034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d166871280d49508910bd80dc0bbd81'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.673010 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d166871280d49508910bd80dc0bbd81'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.673624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d166871280d49508910bd80dc0bbd81'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.686101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d166871280d49508910bd80dc0bbd81'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.691810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1268/2488] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:44 2022] DELETE /identity/v3/users/6d166871280d49508910bd80dc0bbd81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:44.696591 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:44.697076 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:44.697174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:44.716258 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:44.717447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:44.772959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:44.775190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:44.780625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1221/2489] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:44.788607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf06e-f526-4979-bd40-56399a37f0ed admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:44.791403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:44.792795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:44.794490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:44.795177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:44.795465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:44.795733 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] PATH_INFO: `/v3/users/b7c25b46e3164afd85f48688d15fab93` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:44.796859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c25b46e3164afd85f48688d15fab93)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:44.798790 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:44.847299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:44.853070 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c25b46e3164afd85f48688d15fab93'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.856087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945f84-7555-4145-9326-77ae33c6cae8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:44.859813 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:44.860416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:44.860611 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c25b46e3164afd85f48688d15fab93'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.860765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:44.860972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:44.869050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c25b46e3164afd85f48688d15fab93'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.870009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c25b46e3164afd85f48688d15fab93'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.871231 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:44.872664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84a448-48d4-4df2-be5f-fe5ab8ad713a service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:44.882465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1222/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:44.883295 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c25b46e3164afd85f48688d15fab93'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:44.892531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1269/2491] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:44 2022] DELETE /identity/v3/users/b7c25b46e3164afd85f48688d15fab93 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:44.894522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:44.894809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:44.895113 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:44.914697 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:44.916108 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:44.922308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:44.986837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1223/2492] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:44.997477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:44.998893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:45.067774 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8364a-301f-42cf-9d67-675703896430 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:45.072291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:45.072912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:45.073192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:45.073463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:45.082660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:45.084141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:45.093827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1270/2493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:45.210281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:45.211897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:45.224482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6882db-0a2f-45c4-b7bf-715d16b1ab04 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:45.230201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:45.230848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:45.231170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:45.231450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] PATH_INFO: `/v3/projects/57aaf39985e244a9a70a4cd0d1a8e68a` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:45.232811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aaf39985e244a9a70a4cd0d1a8e68a)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:45.234799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:45.293665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aaf39985e244a9a70a4cd0d1a8e68a', 'request_id': 'req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.304033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aaf39985e244a9a70a4cd0d1a8e68a', 'request_id': 'req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.311329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aaf39985e244a9a70a4cd0d1a8e68a', 'request_id': 'req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.323082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] The token cache is being invalidate because project 57aaf39985e244a9a70a4cd0d1a8e68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:45.323376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.324040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.325526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1224/2494] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:45 2022] DELETE /identity/v3/projects/57aaf39985e244a9a70a4cd0d1a8e68a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:45.329505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:45.339589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26ff0-3ebe-4608-887c-789a15d520a2 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:45.399561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:45.400199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:45.400485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:45.400784 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] PATH_INFO: `/v3/users/4af17b4090b042818ca5dfd6736e7117` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:45.401928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af17b4090b042818ca5dfd6736e7117)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:45.403922 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:45.440869 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:45.442427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:45.456687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cce641-6c2c-43e1-9c4b-b1ae6e2c021c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:45.462610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:45.463294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:45.463572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:45.463851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] PATH_INFO: `/v3/projects/bbd55e4bfd704d8a95336b8022bcf2a1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:45.464628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af17b4090b042818ca5dfd6736e7117'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.465025 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd55e4bfd704d8a95336b8022bcf2a1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:45.467034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:45.477824 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af17b4090b042818ca5dfd6736e7117'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.487339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af17b4090b042818ca5dfd6736e7117'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.488146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af17b4090b042818ca5dfd6736e7117'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.491289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:45.504927 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af17b4090b042818ca5dfd6736e7117'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.511254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1271/2495] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:45 2022] DELETE /identity/v3/users/4af17b4090b042818ca5dfd6736e7117 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:45.518339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd55e4bfd704d8a95336b8022bcf2a1', 'request_id': 'req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.525823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd55e4bfd704d8a95336b8022bcf2a1', 'request_id': 'req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.531630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd55e4bfd704d8a95336b8022bcf2a1', 'request_id': 'req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.543911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] The token cache is being invalidate because project bbd55e4bfd704d8a95336b8022bcf2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:45.544127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.544793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.546296 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1225/2496] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:45 2022] DELETE /identity/v3/projects/bbd55e4bfd704d8a95336b8022bcf2a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:45.551233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:45.553166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:45.630128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318007ee-2fb5-4fad-92f7-77961d0a4506 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:45.635804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:45.636815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:45.637504 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:45.637937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] PATH_INFO: `/v3/users/e8eb677cde004fecbd68ae36d384e721` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:45.639508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8eb677cde004fecbd68ae36d384e721)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:45.642926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:45.707854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8eb677cde004fecbd68ae36d384e721'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.718821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8eb677cde004fecbd68ae36d384e721'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.728118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8eb677cde004fecbd68ae36d384e721'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.729030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8eb677cde004fecbd68ae36d384e721'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.744621 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8eb677cde004fecbd68ae36d384e721'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:45.753841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1272/2497] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:45 2022] DELETE /identity/v3/users/e8eb677cde004fecbd68ae36d384e721 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:45.838510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:45.840097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:45.872350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:45.933976 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0301b-bbb4-42bc-9ab2-c95295f1b77f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.006312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.007204 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.007481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.007774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] PATH_INFO: `/v3/projects/ea9d0f0d428245108e043af53621f0d6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.009116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9d0f0d428245108e043af53621f0d6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.011089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.063939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9d0f0d428245108e043af53621f0d6', 'request_id': 'req-b530b465-94c7-4529-a20c-f5078ab7b698'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.072809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9d0f0d428245108e043af53621f0d6', 'request_id': 'req-b530b465-94c7-4529-a20c-f5078ab7b698'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.081087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.081293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9d0f0d428245108e043af53621f0d6', 'request_id': 'req-b530b465-94c7-4529-a20c-f5078ab7b698'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.082606 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.097022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] The token cache is being invalidate because project ea9d0f0d428245108e043af53621f0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:46.097324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.097999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b530b465-94c7-4529-a20c-f5078ab7b698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.098654 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd46daa-4243-49a5-9398-f6df38d579d7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.103498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1226/2498] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:45 2022] DELETE /identity/v3/projects/ea9d0f0d428245108e043af53621f0d6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:46.105023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411df37-415e-4a24-b866-cefa7a2a7b88 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.105318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411df37-415e-4a24-b866-cefa7a2a7b88 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.105598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411df37-415e-4a24-b866-cefa7a2a7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.129522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-8411df37-415e-4a24-b866-cefa7a2a7b88 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.130778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8411df37-415e-4a24-b866-cefa7a2a7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.159150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.159783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.160067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.160347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] PATH_INFO: `/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.161486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3021e9f6b346829fa9a2279e9ea94f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.163452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.166266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.182701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.197412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1227/2499] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:46.206447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.206734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.207028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.216239 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3021e9f6b346829fa9a2279e9ea94f', 'request_id': 'req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.224339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3021e9f6b346829fa9a2279e9ea94f', 'request_id': 'req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.229733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.230957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.232046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3021e9f6b346829fa9a2279e9ea94f', 'request_id': 'req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.243793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] The token cache is being invalidate because project 2e3021e9f6b346829fa9a2279e9ea94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:46.244087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.244723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9747d19d-a1cb-4017-9834-52e5e8e0d8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:46.246510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1273/2500] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:46 2022] DELETE /identity/v3/projects/2e3021e9f6b346829fa9a2279e9ea94f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:46.251259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48cf2-b59a-4172-abcc-5c477f5888e2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.251539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48cf2-b59a-4172-abcc-5c477f5888e2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.251809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48cf2-b59a-4172-abcc-5c477f5888e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.271065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-17f48cf2-b59a-4172-abcc-5c477f5888e2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.272268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-17f48cf2-b59a-4172-abcc-5c477f5888e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.293062 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1228/2501] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:46.296870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.305747 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870240c-ee8d-4008-9c7c-aa2a018729b2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.310336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.310921 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.311443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.311669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.312314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:46.312620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.314192 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.325690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1229/2502] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:22:46.329772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.333514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1274/2503] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:46.340056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b641c-fc8a-4083-a341-d146274c7236 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.341747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.342194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.342650 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.345597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.346503 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.346740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.347134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.347867 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.349750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.365405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.366655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.375930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1275/2504] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:46.378306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1230/2505] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:46.380069 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.382132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.389715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457c4f-8812-4ad1-b683-5fc448545e4b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.444352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301855d-f283-4077-a8d7-ae20be704b86 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.447840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.448449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.448728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.448999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.449341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.449640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:46.449947 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.450046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.450233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.450509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.451333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.451668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.453311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.463984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1276/2506] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:46.468674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.480292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1231/2507] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:46.481287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.482841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628cf08-86a6-4ccb-bc0c-42ac8c04c101 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.487675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.488271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.488556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.488837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.489485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.490920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a179a16-e7a4-421d-89ca-4abd1d74b923 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.491470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.496462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.497261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.497548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.497821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.498464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.500112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.510406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1232/2508] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:46.514598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.516392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.525990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1277/2509] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:46.527936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923df127-e104-4744-a339-ca010c7a6f3b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.529968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.567598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.589152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.589768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.590058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.590333 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.591017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.592651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.593879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99437b-6cc5-424a-ba79-b484971bdad8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.598616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.599357 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.599644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.599920 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.600542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.602703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1233/2510] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:46.602900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.606775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.618139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6b58-5787-466a-bd10-50c4a890b6da admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.624057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.624711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.624997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.625274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] PATH_INFO: `/v3/projects/8cab12e0a93a4480b34c69238fabcd9b/users/38a5b83de8b64865b846887cfdf28f70/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.625736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1278/2511] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:46.629668 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.640213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee9a5a-0fab-4cfc-b782-289294810003 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.641360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cab12e0a93a4480b34c69238fabcd9b, user_id=38a5b83de8b64865b846887cfdf28f70, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.644086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.644836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.645426 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.645708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.645981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.646620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.648409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a51799-d7e4-4ff6-9fc9-f270050a84cd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.658143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1234/2512] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:46 2022] PUT /identity/v3/projects/8cab12e0a93a4480b34c69238fabcd9b/users/38a5b83de8b64865b846887cfdf28f70/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:46.667050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1279/2513] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:46.667187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.668574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.668863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.669185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.698229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] MFA Rules not processed for user `38a5b83de8b64865b846887cfdf28f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.699599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.727235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47a26-e6d1-4f3f-9437-c49b2e23a479 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.731924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.732528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.732811 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.733086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.733734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.735608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.745769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1235/2514] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:46.749846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.759826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8a94-8fd0-4d45-ac03-d0ed8f185ba1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.764456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.765085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.765367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.765643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] PATH_INFO: `/v3/projects/2f0ffaf9c3464bfc91e13f0b48074723/users/ac0e49f679d1481b9f4a2d0358149499/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.766219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1280/2515] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:46.784368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0ffaf9c3464bfc91e13f0b48074723, user_id=ac0e49f679d1481b9f4a2d0358149499, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:46.787234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0932-c399-406a-bb4c-c4e29c4b768b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:46.803407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1236/2516] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:46 2022] PUT /identity/v3/projects/2f0ffaf9c3464bfc91e13f0b48074723/users/ac0e49f679d1481b9f4a2d0358149499/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:46.812641 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.813531 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.813914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.814075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.814364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:46.843138 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] MFA Rules not processed for user `ac0e49f679d1481b9f4a2d0358149499`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:46.844359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:46.877840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2266f-1c18-46f5-b42c-84d526442caa None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:46.896595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.910779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1237/2517] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:46.915165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:46.931793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:46.937320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:46.937938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:46.938242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:46.938516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.004655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdb48a-7eb9-483e-9a7d-c0529a74d80b None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.010198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.010899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.011272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.011639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.012354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.014376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.015332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.017422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.029257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1281/2518] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:47.044268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.045913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1238/2519] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:46 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:47.050929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.057137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdaeab-c01c-4015-8ef7-906b726ce8c5 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.119699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800f47-21c8-4ca8-b264-1f1264fe420c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.124779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.125404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.125688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.126006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.126633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.127221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.127850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.128130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.128404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] PATH_INFO: `/v3/users/38a5b83de8b64865b846887cfdf28f70` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.129342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.129607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a5b83de8b64865b846887cfdf28f70)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.131546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.153989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1239/2520] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:47 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:47.153989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.155977 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.168091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094fd7-14fd-449f-98ce-ca4e2224f943 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.172690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.173464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.173636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.173832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] PATH_INFO: `/v3/users/7eccf91e039143f1ba01508a4fdf2ee5` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.174940 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eccf91e039143f1ba01508a4fdf2ee5)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.176861 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.178113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a5b83de8b64865b846887cfdf28f70'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.186062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a5b83de8b64865b846887cfdf28f70'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.194188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a5b83de8b64865b846887cfdf28f70'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.194878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a5b83de8b64865b846887cfdf28f70'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.209537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:47.210853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a5b83de8b64865b846887cfdf28f70'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.218598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1282/2521] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:47 2022] DELETE /identity/v3/users/38a5b83de8b64865b846887cfdf28f70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:47.222693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.224493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.226228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eccf91e039143f1ba01508a4fdf2ee5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.238871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eccf91e039143f1ba01508a4fdf2ee5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.246524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eccf91e039143f1ba01508a4fdf2ee5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.254312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eccf91e039143f1ba01508a4fdf2ee5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.255230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2ddbcf8b-85b8-4d60-b882-52574cb76814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eccf91e039143f1ba01508a4fdf2ee5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:47.257803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:47.263008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1240/2522] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:47 2022] DELETE /identity/v3/users/7eccf91e039143f1ba01508a4fdf2ee5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:47.264587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa813-d131-4e3b-9ec8-7f1444f2d132 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.265388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa813-d131-4e3b-9ec8-7f1444f2d132 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.265703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa813-d131-4e3b-9ec8-7f1444f2d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.285929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5c9fa813-d131-4e3b-9ec8-7f1444f2d132 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:47.287227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5c9fa813-d131-4e3b-9ec8-7f1444f2d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.294516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19d17-134b-49f8-b73e-52658de87469 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.350209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1241/2523] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:47.352080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.352368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.352935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.356573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.357383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.357817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.358352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.359180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.362233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.373562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:47.374114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1283/2524] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:47.374779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.374905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.378634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.383386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1242/2525] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:47.384588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.386773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.398383 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67097-36d7-4bbb-b81d-3a7916789d17 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.403019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.403662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.403943 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.404217 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] PATH_INFO: `/v3/projects/769387e2815b4f1883883a1e281638dc/users/7a83a7358b1e40498ed7e33db82eae4a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.419349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769387e2815b4f1883883a1e281638dc, user_id=7a83a7358b1e40498ed7e33db82eae4a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.422018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.437667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1243/2526] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:47 2022] PUT /identity/v3/projects/769387e2815b4f1883883a1e281638dc/users/7a83a7358b1e40498ed7e33db82eae4a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:47.438135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580db33-9060-4e17-9284-b96bc70a2ab1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.438482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.489683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.490314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.490590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.490861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.496019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a263be-1be6-46e6-8171-3ad2357ac795 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.499897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.500145 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:47.500654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.500936 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.501213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.554092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.556203 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.563975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.565406 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.567029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1284/2527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:47.568115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.575752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1244/2528] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:47.578258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20d72-a0ee-498a-9b6b-97abcf40613b service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.583142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.583738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.584020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.584292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.584928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.586797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78853c6-2c59-4ea6-a85e-14ad521da276 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.597189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1285/2529] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:47.601182 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.611814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad37d-d2cc-41e1-af69-36661d937d54 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.616438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.617114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.618031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.618309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] PATH_INFO: `/v3/projects/769387e2815b4f1883883a1e281638dc/users/7a83a7358b1e40498ed7e33db82eae4a/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.620350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769387e2815b4f1883883a1e281638dc, user_id=7a83a7358b1e40498ed7e33db82eae4a, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.623279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.634004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1245/2530] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:47 2022] PUT /identity/v3/projects/769387e2815b4f1883883a1e281638dc/users/7a83a7358b1e40498ed7e33db82eae4a/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:47.645173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.645544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.645909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.676563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] MFA Rules not processed for user `7a83a7358b1e40498ed7e33db82eae4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:47.677888 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.755071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1286/2531] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:47.763197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.765035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.776334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:47.831760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059eaf3-8de8-4ad3-aa8d-70ef6f718ea2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.842656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.843866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.844391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.844472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.860710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:47.862461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:47.873167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1246/2532] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:47.938525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.940049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.953708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251b5a0-aa24-4b0c-9786-06ccf076d7d7 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:47.960086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:47.961908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:47.961908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:47.961908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:47.963946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:47.968964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:47.970803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.044423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.045883 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.055635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1287/2533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:48.056481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.057921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.072948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c7ec-58cf-4e79-b0bf-6a54e53248d3 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.073747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc2f0-89bf-4872-8003-ec88202d6cdb service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.078027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.078656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.078788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.078923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.079237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] PATH_INFO: `/v3/projects/8cab12e0a93a4480b34c69238fabcd9b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.079413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.079757 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.079970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] PATH_INFO: `/v3/projects/e2aa923458394c4fa2ade9c8ba0fc284` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.080374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cab12e0a93a4480b34c69238fabcd9b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.081186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2aa923458394c4fa2ade9c8ba0fc284)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.082323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.083134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.099125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:48.137300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cab12e0a93a4480b34c69238fabcd9b', 'request_id': 'req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.140185 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2aa923458394c4fa2ade9c8ba0fc284', 'request_id': 'req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.147327 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cab12e0a93a4480b34c69238fabcd9b', 'request_id': 'req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.150698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2aa923458394c4fa2ade9c8ba0fc284', 'request_id': 'req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.156331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cab12e0a93a4480b34c69238fabcd9b', 'request_id': 'req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.159097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2aa923458394c4fa2ade9c8ba0fc284', 'request_id': 'req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.170357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] The token cache is being invalidate because project 8cab12e0a93a4480b34c69238fabcd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:48.170651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.171316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-73738f5a-633b-4cdb-9a4f-561b5bf5ebb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.171446 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] The token cache is being invalidate because project e2aa923458394c4fa2ade9c8ba0fc284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:48.171743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.172445 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.173266 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1247/2534] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:47 2022] DELETE /identity/v3/projects/8cab12e0a93a4480b34c69238fabcd9b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:48.174292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1288/2535] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:48 2022] DELETE /identity/v3/projects/e2aa923458394c4fa2ade9c8ba0fc284 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:48.178019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.178673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fc61f-b6eb-4b3b-8fa5-c5b8b68e0c42 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.178933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fc61f-b6eb-4b3b-8fa5-c5b8b68e0c42 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.179405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.180136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fc61f-b6eb-4b3b-8fa5-c5b8b68e0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.203476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-948fc61f-b6eb-4b3b-8fa5-c5b8b68e0c42 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:48.204891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-948fc61f-b6eb-4b3b-8fa5-c5b8b68e0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.246768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:48.261191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fbc87-7cbf-4316-9b10-d0776f9e0ed0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.268034 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.269092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.269556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.270482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] PATH_INFO: `/v3/users/4e5244d323b44e9baf3df1294ff70f85` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.272103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5244d323b44e9baf3df1294ff70f85)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.274861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.282900 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1248/2536] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:48.290578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.290860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.291159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.311391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:48.312566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.321306 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1249/2537] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:48.325708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.333506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5244d323b44e9baf3df1294ff70f85'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.342206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5244d323b44e9baf3df1294ff70f85'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.356393 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5244d323b44e9baf3df1294ff70f85'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.357043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5244d323b44e9baf3df1294ff70f85'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.366395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaef434-c346-4731-9175-ab708ddd5bd2 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.374217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5244d323b44e9baf3df1294ff70f85'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.376536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.378540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.378824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.379129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.379801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:48.380111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.381918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.400079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1289/2538] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:48 2022] DELETE /identity/v3/users/4e5244d323b44e9baf3df1294ff70f85 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:48.400200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1250/2539] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:22:48.402587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.404432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.432571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:48.484909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735efb8c-421b-4b15-852a-b16c61fc8ecc admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.489844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.490605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.490882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.491206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.491857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.494673 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.528543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1290/2540] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:48.529774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.540703 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f9756-87e8-4b65-a8aa-20d717bfb698 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.603197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.603847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.604094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.604981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.605626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.607676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.630112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1251/2541] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:48.635045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.645431 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f2e1-ff52-418f-b364-9a4e2bbc3808 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.650098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.650694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.650974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.651288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.651926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.653528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.664804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1291/2542] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:48.669154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.679276 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4fd41-9178-445a-b5bc-cb6cad0a8f5e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.684473 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.685073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.685350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.685656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.686387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.687092 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.688011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.689036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.700816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1252/2543] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:48.704680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.707322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4e71f-880b-434d-8086-83cad53d585e admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.712134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.712761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.713037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.713499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] PATH_INFO: `/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.714574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f4fd1185ed4088a4568ba0b313f67f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.716604 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.718471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16958e6e-38a8-4bdf-b101-4367a589b1f1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.724331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.725105 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.725456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.725820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] PATH_INFO: `/v3/projects/f56f78a255a445c6aca3c08666663309/users/ffac8f6ba18a4f458c96726d6af1bbcd/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.741101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56f78a255a445c6aca3c08666663309, user_id=ffac8f6ba18a4f458c96726d6af1bbcd, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.744343 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c31ad-3f2e-43d3-a602-f18f336fd3b7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.756541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1253/2544] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:48 2022] PUT /identity/v3/projects/f56f78a255a445c6aca3c08666663309/users/ffac8f6ba18a4f458c96726d6af1bbcd/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:48.766811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f4fd1185ed4088a4568ba0b313f67f', 'request_id': 'req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.775391 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f4fd1185ed4088a4568ba0b313f67f', 'request_id': 'req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.783172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f4fd1185ed4088a4568ba0b313f67f', 'request_id': 'req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.796119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] The token cache is being invalidate because project e5f4fd1185ed4088a4568ba0b313f67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:48.796421 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.797278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-dcc10fd5-82ba-4f90-bd0e-fdd3685627af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:48.798846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1292/2545] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:48 2022] DELETE /identity/v3/projects/e5f4fd1185ed4088a4568ba0b313f67f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:48.804043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19f6f-4342-4d88-a366-1af0b0052775 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.805218 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19f6f-4342-4d88-a366-1af0b0052775 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.805612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19f6f-4342-4d88-a366-1af0b0052775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.823474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.823759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.824042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.826684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b9b19f6f-4342-4d88-a366-1af0b0052775 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:48.828031 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b9b19f6f-4342-4d88-a366-1af0b0052775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.855222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] MFA Rules not processed for user `ffac8f6ba18a4f458c96726d6af1bbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:48.856541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.890172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1254/2546] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:48.897710 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.897995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.898271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.918085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:48.919309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.923808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1293/2547] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:48.927047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1255/2548] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:48.931886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.932453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:48.933851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:48.948388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec3b7-9180-4de7-9c6c-ad5cda5bfde8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.954763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1e17-438b-4792-9b97-eded96aae376 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:48.955408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.956356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.956826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.957352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.958393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:48.958911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.961835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.961958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:48.962862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:48.963369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:48.963816 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:48.964827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:48.966143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:48.967813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:48.974482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:48.987336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1256/2549] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:48.988664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.000817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe869ee-3b17-4312-bd95-0b5bb00ed4df admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.011089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1294/2550] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:49.011301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.011301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.011301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.011301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.012096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.012339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.015154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.043655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1257/2551] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:48 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.047678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.076586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483935f-c19a-4c9c-8038-4d9e1dc9fbd2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.113509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec561a-b816-4fac-a6ff-6cda1424f06c admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.119334 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.120028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.120256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.120768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.121635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.123715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.138698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.139420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.139723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.140033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.140877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.143314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.153122 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1258/2552] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.155078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.167342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1295/2553] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.167896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5b71-fe67-440a-bd1b-e2828fe64965 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.171202 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.173127 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.173750 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.174040 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.174318 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.175016 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.176763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.183913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e7b30-034b-4bc5-aa88-d96f369bebc0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.188538 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1259/2554] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:49.192141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.192509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.193134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.193420 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.193698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.194518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.196849 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.203568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da3a6-ea7d-43f5-9c41-44d852166846 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.208567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.209189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1296/2555] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:49.209321 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.209672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.210007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.210746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.213372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.213670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.224456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540eb5-62ca-47ff-ae0a-c1d988779b4a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.225660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1260/2556] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:49.230304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.232458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.233062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.233348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.233626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.234275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.235933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.240527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb035e8-901d-438f-a417-5873cb053be6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.245300 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.246210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.246488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.246763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] PATH_INFO: `/v3/projects/e07a23d44af64176804070ffc05cc3f0/users/445ac2130a974877ac2ef50a6925785c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.247599 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1297/2557] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:49.251658 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.261753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6cdc-96fa-476f-84d0-4dba8a1aa831 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.265749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07a23d44af64176804070ffc05cc3f0, user_id=445ac2130a974877ac2ef50a6925785c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.266507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.267199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.267484 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.267788 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] PATH_INFO: `/v3/projects/d7531110633b498bbc3160515640b9c2/users/5d5078a2ab6f44528f956806653b1544/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.268449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a187a8a-569d-4a6a-af66-17a78a367962 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.281998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1261/2558] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/e07a23d44af64176804070ffc05cc3f0/users/445ac2130a974877ac2ef50a6925785c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:49.283269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7531110633b498bbc3160515640b9c2, user_id=5d5078a2ab6f44528f956806653b1544, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.285943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808beb80-ee16-432c-b115-27b5c4cdb0fa admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.293856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.294148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.294462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.300124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1298/2559] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/d7531110633b498bbc3160515640b9c2/users/5d5078a2ab6f44528f956806653b1544/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:49.310165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.310651 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.311052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.322871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] MFA Rules not processed for user `445ac2130a974877ac2ef50a6925785c`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:49.324087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:49.342347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] MFA Rules not processed for user `5d5078a2ab6f44528f956806653b1544`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:49.343882 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:49.368410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:49.400013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1262/2560] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:49.404512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.414800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:49.415763 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1299/2561] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:49.420166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.489468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183a8a-9d5c-471f-a010-f4242cec0772 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.490152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289e7f3-d130-456e-a227-af9933c9f624 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.494367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.494722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.494972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.495284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.495670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.495835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.495936 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.496144 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.496545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.496765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.498349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.498937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.528135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1263/2562] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/projects => generated 357 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:49.531647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1300/2563] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.532200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.536356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.602386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06121-741c-4feb-a1e7-b819af5d8d08 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.606541 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0206-bf97-47bb-85eb-9ddb35a212d8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.608313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.608923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.609211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.609482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.610168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.612354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.612510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.612600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.612755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.613035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.613664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.615632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.635993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1264/2564] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.639801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.643062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1301/2565] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:49.646646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.654581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff018-563c-498e-a865-a28444657046 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.658537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2adfe-3b68-49b3-9f25-f98f9b1d7cd7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.659289 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.659959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.660307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.660651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.661412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.663141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.663584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.664331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.664618 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.664900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.665875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.667179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.678341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1265/2566] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:49.678516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1302/2567] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:49.679823 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.681115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.691073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933db41-2219-428a-b608-b9fd1e543daf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.691237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1fe08-d972-481e-ad65-e37982f0b5fc admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.696237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.696795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.697063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.697344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.697507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.697627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] PATH_INFO: `/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d/users/8dc4ffae242d4a34abdc906709bf7300/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.697785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.698046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] PATH_INFO: `/v3/projects/b57592d5b2b44b39b196efab3d39d579/users/3612dd14829f4472b61f9e2ea6c207c0/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.713827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf475a5db5e4ec291434a0c0e54c51d, user_id=8dc4ffae242d4a34abdc906709bf7300, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.714964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57592d5b2b44b39b196efab3d39d579, user_id=3612dd14829f4472b61f9e2ea6c207c0, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.716732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.718058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.731320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1303/2568] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d/users/8dc4ffae242d4a34abdc906709bf7300/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:49.732409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1266/2569] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/b57592d5b2b44b39b196efab3d39d579/users/3612dd14829f4472b61f9e2ea6c207c0/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:49.735316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.736100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.746485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:49.795527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:49.812076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8df7-5226-408a-86f8-c18c103365df admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.813773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5f66-9b65-417e-af69-e31c246b6840 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.817165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.817705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.817990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.818265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.818940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.819402 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.820793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.821239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.821364 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.821565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.822462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.824758 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.831804 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1304/2570] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:49.835648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.839713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1267/2571] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:49.840662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:49.851534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0178d-6b91-43d1-9aac-6edd157ab17c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.851905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e58ed-2a84-484b-bdd4-321e84107045 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:49.856705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.857361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.857645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.857921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] PATH_INFO: `/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d/users/8dc4ffae242d4a34abdc906709bf7300/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.859941 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf475a5db5e4ec291434a0c0e54c51d, user_id=8dc4ffae242d4a34abdc906709bf7300, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.860111 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:49.862702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6b2df-88b0-410b-997e-9f74a8c2209f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.864184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.864184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.864184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] PATH_INFO: `/v3/projects/b57592d5b2b44b39b196efab3d39d579/users/3612dd14829f4472b61f9e2ea6c207c0/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.867322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57592d5b2b44b39b196efab3d39d579, user_id=3612dd14829f4472b61f9e2ea6c207c0, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:49.870268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35221ba9-6caf-4198-a1e8-590a80c327e5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:49.883268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1305/2572] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d/users/8dc4ffae242d4a34abdc906709bf7300/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:49.888235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.888551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.888829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.890799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1268/2573] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:49 2022] PUT /identity/v3/projects/b57592d5b2b44b39b196efab3d39d579/users/3612dd14829f4472b61f9e2ea6c207c0/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:49.903836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:49.904143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:49.904539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:49.927302 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] MFA Rules not processed for user `8dc4ffae242d4a34abdc906709bf7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:49.928630 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:49.934725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] MFA Rules not processed for user `3612dd14829f4472b61f9e2ea6c207c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:49.936172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:50.004510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1306/2574] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:50.018173 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:50.019957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:50.025763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1269/2575] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:50.079871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf129d-93a4-41b1-b951-3908cdd0173d None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:50.090610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:50.091831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:50.092896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:50.093221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:50.093490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:50.093599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:50.106021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983681ea-7c94-44e9-84d3-783df1947e11 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:50.109838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:50.110435 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:50.110716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:50.110995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:50.121273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:50.121902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:50.122701 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:50.132444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1270/2576] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:50.156525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:50.157874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:50.172935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1307/2577] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:50.340751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:50.352191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129482e-70a2-4a4f-a666-b20391ea7ad3 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:50.356540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:50.357144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:50.357429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:50.357712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:50.431456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:50.445369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:50.445369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1271/2578] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:51.698304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:51.699998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:51.787645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:51.798647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148d89-c8c3-472b-99cf-ecba5d5a5cb7 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:51.802490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee2bd-938b-42a3-bc80-012206ddf8a4 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:51.802622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:51.803235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:51.803551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:51.803927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:51.810781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:51.812109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:51.813290 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:51.813898 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] PATH_INFO: `/v3/users/ac0e49f679d1481b9f4a2d0358149499` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:51.815536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0e49f679d1481b9f4a2d0358149499)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:51.817423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:51.860141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:51.877864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0e49f679d1481b9f4a2d0358149499'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:51.882669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:51.884154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0a250-e444-40e3-b335-5a56af97fe99 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:51.888263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0e49f679d1481b9f4a2d0358149499'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:51.895286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1272/2579] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:22:51.896103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0e49f679d1481b9f4a2d0358149499'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:51.896803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0e49f679d1481b9f4a2d0358149499'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:51.910439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0e49f679d1481b9f4a2d0358149499'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:51.917377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1308/2580] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:51 2022] DELETE /identity/v3/users/ac0e49f679d1481b9f4a2d0358149499 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:51.922014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:51.922307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:51.922587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:51.944068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:51.945337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.010607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1273/2581] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:52.020260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:52.021646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.076377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.081718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6bd-3144-4b16-ba41-031b597fd19d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:52.087316 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:52.088128 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:52.088412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:52.088692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:52.099628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:52.101301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:52.111521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1309/2582] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:52.399972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:52.401512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.413992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e86c-1c37-4edd-95e9-e0715076bab1 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:52.419413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:52.420177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:52.420526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:52.420871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] PATH_INFO: `/v3/projects/2f0ffaf9c3464bfc91e13f0b48074723` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:52.422143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0ffaf9c3464bfc91e13f0b48074723)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:52.424569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:52.444671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:52.446514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.475239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0ffaf9c3464bfc91e13f0b48074723', 'request_id': 'req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.483349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0ffaf9c3464bfc91e13f0b48074723', 'request_id': 'req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.489604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0ffaf9c3464bfc91e13f0b48074723', 'request_id': 'req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.501571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] The token cache is being invalidate because project 2f0ffaf9c3464bfc91e13f0b48074723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:52.501859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.502666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.504317 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1274/2583] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:52 2022] DELETE /identity/v3/projects/2f0ffaf9c3464bfc91e13f0b48074723 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:52.505113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68bbf-7ae9-40cd-8c29-1486dca5b785 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:52.508658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:52.510259 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.558354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:52.559091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:52.559449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:52.559734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:52.561447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:52.575194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfb6b-bdb0-42b7-b879-4d310639b6f2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:52.579819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:52.580444 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:52.580724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:52.580998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] PATH_INFO: `/v3/users/7a83a7358b1e40498ed7e33db82eae4a` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:52.582148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a83a7358b1e40498ed7e33db82eae4a)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:52.584124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:52.586534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.629288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:52.630869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:52.634257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a83a7358b1e40498ed7e33db82eae4a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.641018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1310/2584] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:52.646711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a83a7358b1e40498ed7e33db82eae4a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.654156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a83a7358b1e40498ed7e33db82eae4a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.662177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a83a7358b1e40498ed7e33db82eae4a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.662734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-6a84b2d3-0a9d-47bc-a3b3-3ce99100d51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a83a7358b1e40498ed7e33db82eae4a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:52.669658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1275/2585] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:52 2022] DELETE /identity/v3/users/7a83a7358b1e40498ed7e33db82eae4a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:52.990329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.008029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d0e5-b068-4102-a52f-40acfc6c82e3 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.074063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.082996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.083627 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.083912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.084184 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] PATH_INFO: `/v3/projects/769387e2815b4f1883883a1e281638dc` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.085331 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769387e2815b4f1883883a1e281638dc)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.088155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.137326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769387e2815b4f1883883a1e281638dc', 'request_id': 'req-57e78e5b-25d0-4efc-b7df-5b178078d439'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:53.144896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769387e2815b4f1883883a1e281638dc', 'request_id': 'req-57e78e5b-25d0-4efc-b7df-5b178078d439'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:53.153127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769387e2815b4f1883883a1e281638dc', 'request_id': 'req-57e78e5b-25d0-4efc-b7df-5b178078d439'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:53.165748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] The token cache is being invalidate because project 769387e2815b4f1883883a1e281638dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:53.166041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:53.166707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-57e78e5b-25d0-4efc-b7df-5b178078d439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:53.168419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1311/2586] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:52 2022] DELETE /identity/v3/projects/769387e2815b4f1883883a1e281638dc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:53.173194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.173724 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.173822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.200478 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:53.201728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:53.284952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1276/2587] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:53.286645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.286943 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.287259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.308873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:53.310083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:53.318008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1312/2588] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:53.322897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.332785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44358-3802-48bd-99e6-52df5c1e5242 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.337636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.338253 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.338536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.338809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.339498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:53.339802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.341392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.353891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1277/2589] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:53.358170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.368193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8142dd-5894-469e-a7ef-b3dd9f8f8c30 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.373219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.373811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.374107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.374359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.375006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.376926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.403585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1313/2590] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:53.407642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.418090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53106d-35ea-4a79-8f16-afc8ef6af8bf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.479082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.479691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.479972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.480278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.480903 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.482822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.499341 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.505592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1278/2591] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:53.510037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.520401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3484f1-88fa-47ff-a1d0-0c97645624ba admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.525327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.525919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.526197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.526491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.527190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.528874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.539835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1314/2592] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:53.543859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.553835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720604-5eb9-4eec-baf8-00b67d510a2b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.559069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.559664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.559951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.560227 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.560872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.562458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc34a5-0a37-4949-a86d-4f96a27dee2e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.572884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1279/2593] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:53.576884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.586813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726734ae-65b1-44da-9968-3c2027760e93 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.591338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.591974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.592253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.592530 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] PATH_INFO: `/v3/projects/bc330584a7ba4cc9abd0c7e7dddb6fda/users/7f4509f9661f4ceaa667b0d43c17b5c5/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.607099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc330584a7ba4cc9abd0c7e7dddb6fda, user_id=7f4509f9661f4ceaa667b0d43c17b5c5, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.609735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.624330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1315/2594] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:53 2022] PUT /identity/v3/projects/bc330584a7ba4cc9abd0c7e7dddb6fda/users/7f4509f9661f4ceaa667b0d43c17b5c5/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:53.634838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.635154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.635431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.662434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] MFA Rules not processed for user `7f4509f9661f4ceaa667b0d43c17b5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:53.663680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:53.731262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1280/2595] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:22:53.735895 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.799655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0816-4b7a-407e-a1f9-1bcce266a66a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.804296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.804905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.805362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.805634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.806256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.808182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.834924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1316/2596] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:53.840480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.853525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb842b-4d97-482b-8d08-a3e064bd1a5f None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.913121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.913759 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.914564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.914841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.915527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.917523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.939862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1281/2597] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:53 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:22:53.944200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.954929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf39c2-6a6b-4944-8e57-4275d9689c8f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.959745 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.960347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.961159 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.961435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:53.962078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:53.963725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:53.965113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.979041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1317/2598] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:53.983256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:53.993508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312bdac-7700-46ab-90e3-4bea30ab4ae4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:53.998487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:53.999162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:53.999877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:53.999877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] PATH_INFO: `/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb/users/152cf2057fa848fcbf937dd44f2bc9e5/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.026348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33ed2af5f814a09887c0089ad4e3aeb, user_id=152cf2057fa848fcbf937dd44f2bc9e5, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:54.029952 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:54.046752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1282/2599] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:53 2022] PUT /identity/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb/users/152cf2057fa848fcbf937dd44f2bc9e5/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:54.050726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:54.061567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff279-f2d6-482d-91d6-45565fc0b124 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:54.121854 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:54.122461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:54.122742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:54.123043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.123684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:54.125298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f14c6c-826b-49d6-847c-e0968abc3006 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:54.136057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1318/2600] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:54.140464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:54.151342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901385b-2352-49f8-96f7-67566a3d047a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:54.155916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:54.156556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:54.156839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:54.157117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] PATH_INFO: `/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb/users/152cf2057fa848fcbf937dd44f2bc9e5/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.159073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33ed2af5f814a09887c0089ad4e3aeb, user_id=152cf2057fa848fcbf937dd44f2bc9e5, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:54.161704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:54.171650 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1283/2601] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:54 2022] PUT /identity/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb/users/152cf2057fa848fcbf937dd44f2bc9e5/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:22:54.182743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:54.183133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:54.183414 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.211916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] MFA Rules not processed for user `152cf2057fa848fcbf937dd44f2bc9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:54.213152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:54.283211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1319/2602] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:54.293737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:54.295656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:54.330545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:54.358932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e800-6dda-46c3-905d-b0836cee609b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:54.362632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:54.363271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:54.363562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:54.363826 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.374309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:54.375877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:54.385851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1284/2603] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:54.546929 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:54.557728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77462d-9cff-4b6d-871c-15b7d6b318b5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:54.561328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:54.561933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:54.562211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:54.562482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:54.621047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:54.622412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9845a5-c57e-4dcd-9c11-24c8f362cba6 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:54.634057 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1320/2604] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:56.544599 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:56.546019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:56.610046 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32453-54fb-4623-b734-0faf71d5def7 service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:56.614609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:56.615275 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:56.615559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:56.615838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] PATH_INFO: `/v3/users/ffac8f6ba18a4f458c96726d6af1bbcd` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:56.617221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffac8f6ba18a4f458c96726d6af1bbcd)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:56.619332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:56.667752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffac8f6ba18a4f458c96726d6af1bbcd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:56.679860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffac8f6ba18a4f458c96726d6af1bbcd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:56.686721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffac8f6ba18a4f458c96726d6af1bbcd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:56.694071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffac8f6ba18a4f458c96726d6af1bbcd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:56.694692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffac8f6ba18a4f458c96726d6af1bbcd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:56.701110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1285/2605] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:56 2022] DELETE /identity/v3/users/ffac8f6ba18a4f458c96726d6af1bbcd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:56.705522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:56.706009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:56.706132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:56.726047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:56.727276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:56.736465 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:56.785172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1321/2606] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:56.795655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:56.797093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:56.855310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696fa83-d33d-47d5-a761-c2e10c88ba80 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:56.858972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:56.859608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:56.859891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:56.860168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:56.866098 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:56.872139 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:56.873989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:56.885571 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1286/2607] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:22:57.161164 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:57.162747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:57.175699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428240ce-14bd-4277-b1dd-f5ae83bd9ce1 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:57.191610 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:57.192262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:57.192543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:57.193049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] PATH_INFO: `/v3/projects/f56f78a255a445c6aca3c08666663309` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:57.194196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56f78a255a445c6aca3c08666663309)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:57.196244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:57.267085 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56f78a255a445c6aca3c08666663309', 'request_id': 'req-49ff81fd-8113-4844-89b8-fa6f82b8b68c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.277168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56f78a255a445c6aca3c08666663309', 'request_id': 'req-49ff81fd-8113-4844-89b8-fa6f82b8b68c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.286828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56f78a255a445c6aca3c08666663309', 'request_id': 'req-49ff81fd-8113-4844-89b8-fa6f82b8b68c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.299743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] The token cache is being invalidate because project f56f78a255a445c6aca3c08666663309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:57.300238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.300933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.306525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1322/2608] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:57 2022] DELETE /identity/v3/projects/f56f78a255a445c6aca3c08666663309 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:57.308223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:57.319361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad793-3c28-4e87-9ee8-9759c67c5968 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:57.396133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:57.396993 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:57.397142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:57.397312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] PATH_INFO: `/v3/users/5d5078a2ab6f44528f956806653b1544` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:57.398499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5078a2ab6f44528f956806653b1544)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:57.400465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:57.468422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5078a2ab6f44528f956806653b1544'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.483906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5078a2ab6f44528f956806653b1544'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.492344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5078a2ab6f44528f956806653b1544'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.503154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5078a2ab6f44528f956806653b1544'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.503154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5078a2ab6f44528f956806653b1544'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.509877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1287/2609] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:57 2022] DELETE /identity/v3/users/5d5078a2ab6f44528f956806653b1544 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:57.823884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:57.825660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:57.841497 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff81fd-8113-4844-89b8-fa6f82b8b68c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:57.908509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:57.909136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:57.909417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:57.909688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] PATH_INFO: `/v3/projects/d7531110633b498bbc3160515640b9c2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:57.910797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7531110633b498bbc3160515640b9c2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:57.912749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:57.953436 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:57.960090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7531110633b498bbc3160515640b9c2', 'request_id': 'req-1ab499a5-8494-42c8-bb80-8b32b5402abd'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.968020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7531110633b498bbc3160515640b9c2', 'request_id': 'req-1ab499a5-8494-42c8-bb80-8b32b5402abd'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.974093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7531110633b498bbc3160515640b9c2', 'request_id': 'req-1ab499a5-8494-42c8-bb80-8b32b5402abd'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.984395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] The token cache is being invalidate because project d7531110633b498bbc3160515640b9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:57.984683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.985309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:57.986768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1323/2610] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:57 2022] DELETE /identity/v3/projects/d7531110633b498bbc3160515640b9c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:57.990876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:57.992438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:58.005662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680c16-e2bc-4729-adc1-a61a89b1b029 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:58.064195 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:58.064827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.065110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.065388 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] PATH_INFO: `/v3/users/8dc4ffae242d4a34abdc906709bf7300` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.066507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc4ffae242d4a34abdc906709bf7300)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:58.068487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:58.083184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:58.117065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc4ffae242d4a34abdc906709bf7300'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.129718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc4ffae242d4a34abdc906709bf7300'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.137149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc4ffae242d4a34abdc906709bf7300'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.144434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc4ffae242d4a34abdc906709bf7300'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.145055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ce6e13e9-5136-436b-a312-58e926ee7852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc4ffae242d4a34abdc906709bf7300'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.151885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1288/2611] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:22:57 2022] DELETE /identity/v3/users/8dc4ffae242d4a34abdc906709bf7300 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:58.457863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:58.459338 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:58.473285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab499a5-8494-42c8-bb80-8b32b5402abd admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:58.542529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:58.542529 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.542856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.542856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] PATH_INFO: `/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.544004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf475a5db5e4ec291434a0c0e54c51d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:58.545935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:58.600961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf475a5db5e4ec291434a0c0e54c51d', 'request_id': 'req-6dcd512f-04fd-4090-808e-c07f24eef537'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.609348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf475a5db5e4ec291434a0c0e54c51d', 'request_id': 'req-6dcd512f-04fd-4090-808e-c07f24eef537'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.621219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf475a5db5e4ec291434a0c0e54c51d', 'request_id': 'req-6dcd512f-04fd-4090-808e-c07f24eef537'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.632129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] The token cache is being invalidate because project 5cf475a5db5e4ec291434a0c0e54c51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:22:58.632558 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.633263 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6dcd512f-04fd-4090-808e-c07f24eef537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:22:58.634858 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1324/2612] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:58 2022] DELETE /identity/v3/projects/5cf475a5db5e4ec291434a0c0e54c51d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:58.639846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.640136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.640419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.665564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:58.666782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:58.760785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1289/2613] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:58.769526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.769526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.769526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.794165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:58.795557 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:58.807852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1325/2614] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:58.813261 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:58.828763 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17573-69a1-414e-a759-c15c2fcae28e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:58.843973 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:58.844605 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.845019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.845160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.845841 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:22:58.846168 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:58.848692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:58.867396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1290/2615] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:22:58.872510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:58.886049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacfc09-9064-42a6-904b-36fb61aeadaf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:58.891850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:58.892624 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:58.892900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:58.893166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:58.893810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:58.895893 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:58.939412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1326/2616] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:22:58 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:58.940644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:58.957693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acb19-5c64-40a8-a01e-4bdc3142f831 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:59.041545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:59.043057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.043279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.043737 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.045052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:59.048967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:59.076477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1291/2617] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:22:58 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:22:59.080660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:59.099113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2920b1-849d-43d8-a2a7-c391b8146e9d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:59.105126 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:59.105901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.106268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.106582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.107330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:59.115697 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:59.127306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1327/2618] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:22:59.130904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:59.142776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd0e1-02d4-4c2e-91a2-5b6e8761aa44 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:59.148407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:59.149015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.149396 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.149671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.150352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:59.151975 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37c7a8-a76e-42b0-ac2d-d6f5bd779eab admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:59.154319 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:59.167123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1292/2619] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:22:59.171016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:59.181572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f4a6-fd2f-4968-b8e7-a6ea1249ce14 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:59.186116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:59.186754 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.187060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.187334 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] PATH_INFO: `/v3/projects/bb98eee2270e47aba61d25583249e0f2/users/b77abd336958480099d36e3e9d1ec56b/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.202026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb98eee2270e47aba61d25583249e0f2, user_id=b77abd336958480099d36e3e9d1ec56b, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:59.204734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:59.207829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:59.220105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1328/2620] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:22:59 2022] PUT /identity/v3/projects/bb98eee2270e47aba61d25583249e0f2/users/b77abd336958480099d36e3e9d1ec56b/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:22:59.232066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.232377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.232657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.260989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] MFA Rules not processed for user `b77abd336958480099d36e3e9d1ec56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:22:59.262454 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:59.328803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1293/2621] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:22:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:22:59.344033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:22:59.346470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:22:59.406110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60396-8238-4ab4-bbf6-8e84f2942b90 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:22:59.409838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:22:59.410447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:22:59.410732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:22:59.411031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:22:59.419285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:22:59.420725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586e9d-9a16-4d14-9fcb-78c1da27d37f service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:22:59.429532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1329/2622] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:22:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:00.059116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:00.060561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:00.125456 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822bd9-714d-49eb-ab5b-99851e02242d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:00.129824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:00.130440 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:00.130718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:00.131006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] PATH_INFO: `/v3/users/7f4509f9661f4ceaa667b0d43c17b5c5` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:00.132112 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4509f9661f4ceaa667b0d43c17b5c5)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:00.134311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:00.178051 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4509f9661f4ceaa667b0d43c17b5c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.191392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4509f9661f4ceaa667b0d43c17b5c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.198966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4509f9661f4ceaa667b0d43c17b5c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.207707 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4509f9661f4ceaa667b0d43c17b5c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.208332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4509f9661f4ceaa667b0d43c17b5c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.214874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1294/2623] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:00 2022] DELETE /identity/v3/users/7f4509f9661f4ceaa667b0d43c17b5c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:00.219346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:00.219813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:00.220076 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:00.240930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:00.242825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:00.303751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1330/2624] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:00.314462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:00.315969 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:00.326512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:00.380818 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707779f-8df1-41f8-9afd-4e4718007556 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:00.384839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:00.385450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:00.385730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:00.386005 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:00.395324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:00.396776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:00.406881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1295/2625] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:00.690820 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:00.692361 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:00.704813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f773b-71cc-4039-80bc-3a21e1fa6290 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:00.709366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:00.709992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:00.710270 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:00.711289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] PATH_INFO: `/v3/projects/bc330584a7ba4cc9abd0c7e7dddb6fda` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:00.712457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc330584a7ba4cc9abd0c7e7dddb6fda)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:00.714367 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:00.767388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc330584a7ba4cc9abd0c7e7dddb6fda', 'request_id': 'req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.778297 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc330584a7ba4cc9abd0c7e7dddb6fda', 'request_id': 'req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.786710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc330584a7ba4cc9abd0c7e7dddb6fda', 'request_id': 'req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.798584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] The token cache is being invalidate because project bc330584a7ba4cc9abd0c7e7dddb6fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:00.798954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.799656 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.801129 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1331/2626] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:00 2022] DELETE /identity/v3/projects/bc330584a7ba4cc9abd0c7e7dddb6fda => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:00.805506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:00.816034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e25f4-3b77-4bd9-b2db-6da09a2f2ee5 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:00.880007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:00.880674 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:00.880951 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:00.881222 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] PATH_INFO: `/v3/users/152cf2057fa848fcbf937dd44f2bc9e5` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:00.882549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152cf2057fa848fcbf937dd44f2bc9e5)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:00.884615 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:00.938158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152cf2057fa848fcbf937dd44f2bc9e5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.951226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152cf2057fa848fcbf937dd44f2bc9e5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.958609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152cf2057fa848fcbf937dd44f2bc9e5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.967915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152cf2057fa848fcbf937dd44f2bc9e5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.968549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c754539-a860-450e-a773-6e7fd6d7bcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152cf2057fa848fcbf937dd44f2bc9e5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:00.975469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1296/2627] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:00 2022] DELETE /identity/v3/users/152cf2057fa848fcbf937dd44f2bc9e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:01.266519 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.268221 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:01.286713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dfa89-46e9-46cf-b1df-f8a8f1e081eb admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.309158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:01.355787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.356427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.356708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.356982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] PATH_INFO: `/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.358124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33ed2af5f814a09887c0089ad4e3aeb)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.360103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.416096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33ed2af5f814a09887c0089ad4e3aeb', 'request_id': 'req-2cf4aaca-99f5-4461-80f1-460896aa1589'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:01.425885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33ed2af5f814a09887c0089ad4e3aeb', 'request_id': 'req-2cf4aaca-99f5-4461-80f1-460896aa1589'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:01.434388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33ed2af5f814a09887c0089ad4e3aeb', 'request_id': 'req-2cf4aaca-99f5-4461-80f1-460896aa1589'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:01.445965 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] The token cache is being invalidate because project c33ed2af5f814a09887c0089ad4e3aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:01.446396 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:01.447125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cf4aaca-99f5-4461-80f1-460896aa1589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:01.448625 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1332/2628] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:01 2022] DELETE /identity/v3/projects/c33ed2af5f814a09887c0089ad4e3aeb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:01.454602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.455132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.455331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.478061 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:01.479357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:01.504666 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:01.542243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1297/2629] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:01.550208 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.550498 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.550779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.570801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:01.572041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:01.579889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1333/2630] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:01.584140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.594567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da19a-de65-4c24-a427-d36c9b9478e9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.599493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.600091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.600368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.600641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.601288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:01.601592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.603202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.615092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1298/2631] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:01.619383 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.628805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280241-5d1b-4864-940b-8373cc247dab None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.634897 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.635590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.635862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.636131 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.636773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.638815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.668335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1334/2632] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:01 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:01.674515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.686631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51e05-f1f6-430e-9d2e-c88f0551d9f2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.751655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.752252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.752662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.752967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.753645 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.755641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.777525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1299/2633] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:01 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:01.781765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.792466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11730-d5d6-40de-a438-82236575bc60 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.797286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.797878 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.798155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.798427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.799283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.800887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.810919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1335/2634] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:01.815146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.825709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b462-efd5-4130-8972-a5945ca30760 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.830384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.831009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.831373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.831649 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.832320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.833914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672f3a-c009-415a-8edd-8377fb5dae95 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.846209 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1300/2635] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:01.850376 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.860990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08348-aeef-4f81-b285-698b01930d06 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:01.865712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:01.866356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.866666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.866937 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] PATH_INFO: `/v3/projects/71d13926aede402197a210920713b405/users/b41ae60ee987459cb0d37ec80e85efa3/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.881510 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d13926aede402197a210920713b405, user_id=b41ae60ee987459cb0d37ec80e85efa3, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:01.884793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:01.898705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1336/2636] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:01 2022] PUT /identity/v3/projects/71d13926aede402197a210920713b405/users/b41ae60ee987459cb0d37ec80e85efa3/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:01.903825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd29a-9d8f-48c2-97a4-364c995de971 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:01.904134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd29a-9d8f-48c2-97a4-364c995de971 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:01.904416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd29a-9d8f-48c2-97a4-364c995de971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:01.923078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-372bd29a-9d8f-48c2-97a4-364c995de971 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:01.924279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-372bd29a-9d8f-48c2-97a4-364c995de971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:01.983696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1301/2637] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:01.993744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:01.995794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:02.048321 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:02.052240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc801f8-5835-498e-9cae-1d487a2b52e1 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:02.057495 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:02.058260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:02.058752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:02.059228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:02.068700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:02.070766 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:02.080123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1337/2638] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:02.983056 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa614b0-3175-4c85-b462-7fe99f2b0409 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:02.983621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa614b0-3175-4c85-b462-7fe99f2b0409 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:02.983621 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa614b0-3175-4c85-b462-7fe99f2b0409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:03.016933 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-afa614b0-3175-4c85-b462-7fe99f2b0409 None None] MFA Rules not processed for user `b41ae60ee987459cb0d37ec80e85efa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:03.018082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-afa614b0-3175-4c85-b462-7fe99f2b0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:03.051857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:03.108491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1302/2639] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:03.119901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:03.121646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:03.189288 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc006d9-f6a9-4e03-b9b3-caaeae822a04 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:03.192853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:03.193453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:03.193736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:03.194011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:03.202417 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:03.203891 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:03.212670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1338/2640] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:04.571822 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:04.572391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:04.572391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:04.591255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] MFA Rules not processed for user `b41ae60ee987459cb0d37ec80e85efa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:04.592519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:04.599624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1303/2641] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:04.852664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:04.862690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09a2f-46d5-4d2a-83f3-1abdec7457cc service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:04.866559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:04.868493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:04.868880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:04.869224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:04.871377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:04.881870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:04.884771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b4be1-eb87-4e95-9579-35dbc4194345 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:04.893374 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1339/2642] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:05.799423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:05.800830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:05.814146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e497ce1-7a81-40ad-aafa-fa44a3a5bf22 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:05.818564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:05.819372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:05.819654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:05.819925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] PATH_INFO: `/v3/users/445ac2130a974877ac2ef50a6925785c` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:05.821286 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=445ac2130a974877ac2ef50a6925785c)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:05.823233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:05.871054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445ac2130a974877ac2ef50a6925785c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:05.883248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445ac2130a974877ac2ef50a6925785c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:05.890260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445ac2130a974877ac2ef50a6925785c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:05.897722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445ac2130a974877ac2ef50a6925785c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:05.898552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445ac2130a974877ac2ef50a6925785c'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:05.905160 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1304/2643] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:05 2022] DELETE /identity/v3/users/445ac2130a974877ac2ef50a6925785c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:05.909799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:05.910257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:05.910534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:05.930135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:05.931428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:05.990954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1340/2644] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:06.000863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:06.002277 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:06.060986 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b715-ce0e-4d41-a1dd-78c33ff29bee admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:06.064530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:06.065130 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:06.065407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:06.065678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:06.075119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:06.076528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:06.085803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1305/2645] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:06.421661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:06.423191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:06.437068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e18b78-4bd3-4a83-8497-17c51077dc83 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:06.446585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:06.447731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:06.448398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:06.448875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] PATH_INFO: `/v3/projects/e07a23d44af64176804070ffc05cc3f0` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:06.451960 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07a23d44af64176804070ffc05cc3f0)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:06.454317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:06.512821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07a23d44af64176804070ffc05cc3f0', 'request_id': 'req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.521769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07a23d44af64176804070ffc05cc3f0', 'request_id': 'req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.533082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07a23d44af64176804070ffc05cc3f0', 'request_id': 'req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.547828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] The token cache is being invalidate because project e07a23d44af64176804070ffc05cc3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:06.548363 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.549022 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.550864 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1341/2646] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:06 2022] DELETE /identity/v3/projects/e07a23d44af64176804070ffc05cc3f0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:06.555539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:06.588017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c61bb-a0e7-46e3-b53d-91c991f4761b service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:06.631255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:06.675530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:06.676170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:06.676450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:06.676726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] PATH_INFO: `/v3/users/3612dd14829f4472b61f9e2ea6c207c0` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:06.677862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3612dd14829f4472b61f9e2ea6c207c0)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:06.680356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:06.728408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3612dd14829f4472b61f9e2ea6c207c0'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.741235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3612dd14829f4472b61f9e2ea6c207c0'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.749234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3612dd14829f4472b61f9e2ea6c207c0'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.757208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3612dd14829f4472b61f9e2ea6c207c0'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.757834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-682e541e-d827-4c24-bd3e-7c038f5bddb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3612dd14829f4472b61f9e2ea6c207c0'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:06.767699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1306/2647] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:06 2022] DELETE /identity/v3/users/3612dd14829f4472b61f9e2ea6c207c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:07.061609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.063279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:07.073077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:07.077451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3dde-6aa5-4ea1-b9d8-869f5ebff357 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.137215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.137769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.138053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.138332 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] PATH_INFO: `/v3/projects/b57592d5b2b44b39b196efab3d39d579` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.139486 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57592d5b2b44b39b196efab3d39d579)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.141408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.190429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57592d5b2b44b39b196efab3d39d579', 'request_id': 'req-b8bc3e80-49cb-42de-b600-f31cb64eacca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:07.198826 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57592d5b2b44b39b196efab3d39d579', 'request_id': 'req-b8bc3e80-49cb-42de-b600-f31cb64eacca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:07.205141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57592d5b2b44b39b196efab3d39d579', 'request_id': 'req-b8bc3e80-49cb-42de-b600-f31cb64eacca'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:07.216060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] The token cache is being invalidate because project b57592d5b2b44b39b196efab3d39d579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:07.216352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:07.216990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-b8bc3e80-49cb-42de-b600-f31cb64eacca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:07.218488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1342/2648] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:07 2022] DELETE /identity/v3/projects/b57592d5b2b44b39b196efab3d39d579 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:07.223320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.223799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.223907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.243912 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:07.245117 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:07.306795 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1307/2649] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:07.314457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.314738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.315035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.335664 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:07.338419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:07.348211 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1343/2650] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:07.353620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.372474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a0dca-b549-4d86-86cb-24c013f9b907 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.377466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.378087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.378348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.378622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.379305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:07.379612 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.381336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.399859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1308/2651] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:07.404072 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.414002 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6268f4-f977-4ae8-9e95-3e435e8da158 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.420633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.421254 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.421531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.421806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.422859 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.424807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.462146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1344/2652] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:07 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:07.464226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.483572 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99338-afd2-4f4b-a6e4-422c16f7c146 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.549205 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:07.572180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.573015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.573390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.573769 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.574655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.576801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.602816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1309/2653] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:07 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:07.604101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.614556 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b639-c656-4482-a081-41831468e860 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.619592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.620532 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.620913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.621253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.621977 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.623686 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.635025 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1345/2654] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:07.640809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.652285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d93f2-2f09-47b8-8292-0a78bf8231d9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.659104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.660330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.660692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.661043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.661771 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.663671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739896a6-a4eb-429a-8f29-f5b6d5ad8bf9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.802467 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1310/2655] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:07.807151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:07.827214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a842-481f-4729-b780-7d35fbc863d2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:07.827214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:07.827214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:07.827214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:07.827539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] PATH_INFO: `/v3/projects/5aa817c7086a42c2ad240acc406dcba0/users/5ad6327a68bf4e98a7c08a1b1711d415/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:07.975151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa817c7086a42c2ad240acc406dcba0, user_id=5ad6327a68bf4e98a7c08a1b1711d415, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:07.978644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:07.993425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1346/2656] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:07 2022] PUT /identity/v3/projects/5aa817c7086a42c2ad240acc406dcba0/users/5ad6327a68bf4e98a7c08a1b1711d415/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:08.006043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.009366 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.009876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.045055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] MFA Rules not processed for user `5ad6327a68bf4e98a7c08a1b1711d415`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:08.046418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:08.126730 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1311/2657] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:08.130958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.181256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:08.219892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4242-42aa-4910-b32a-074ea189bd2c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.226245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.227934 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.228442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.229021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.229871 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.232957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.278693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1347/2658] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:08 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:08.282850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.295611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44f35-46fb-432f-aac9-3d883f1475ed None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.360094 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.360706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.360983 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.361248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.361876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.363800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.386852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1312/2659] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:08 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:08.390720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.402727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05341686-63e8-4b15-97e8-1a023d66e1fb admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.407386 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.407916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.408218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.408488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.409118 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.410704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.421027 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1348/2660] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:08.425118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.436043 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842829-4634-4674-bc65-1a0847eb9ccf admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.441086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.441837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.442135 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.442466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] PATH_INFO: `/v3/projects/480078a19cf94013bec8fa1ba3161a83/users/2820c80c41704d3f8def99a037b2c3c9/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.458223 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] RBAC: Authorizing `identity:create_grant(project_id=480078a19cf94013bec8fa1ba3161a83, user_id=2820c80c41704d3f8def99a037b2c3c9, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.460946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.474762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1313/2661] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:08 2022] PUT /identity/v3/projects/480078a19cf94013bec8fa1ba3161a83/users/2820c80c41704d3f8def99a037b2c3c9/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:08.478884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.489031 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a5448-b9f4-487c-bb8c-c94a983318c5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.551162 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.551775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.552050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.552526 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.553169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.554807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9edd-c537-437f-886d-a4ebdc63a522 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.565369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1349/2662] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:08.569519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.580810 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb0f4-a8d6-4640-bd2f-a1c0283a285a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.590506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.590941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.591323 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.591672 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] PATH_INFO: `/v3/projects/480078a19cf94013bec8fa1ba3161a83/users/2820c80c41704d3f8def99a037b2c3c9/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.593871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480078a19cf94013bec8fa1ba3161a83, user_id=2820c80c41704d3f8def99a037b2c3c9, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.596744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.607432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:08.614019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1314/2663] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:08 2022] PUT /identity/v3/projects/480078a19cf94013bec8fa1ba3161a83/users/2820c80c41704d3f8def99a037b2c3c9/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:08.624805 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.625245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.625555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.658725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] MFA Rules not processed for user `2820c80c41704d3f8def99a037b2c3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:08.660063 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:08.739890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1350/2664] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:08.753115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.755460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:08.820390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0ba8-b626-439f-8797-788a34200e42 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.825436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.826060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.826338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.826681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:08.841107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:08.841107 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:08.851325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1315/2665] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:08.957481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:08.968876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b1e63-1da3-4883-9e88-ca91c9bfc2bf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:08.973812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:08.974714 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:08.975041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:08.975328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:09.020775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:09.047107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:09.048675 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fdf57-d116-4a36-b8df-7e017f8e031d service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:09.058401 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1351/2666] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:15.128642 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:15.194939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331270a-98c6-483e-b480-299cf3c0a25c service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:15.200309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:15.200931 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:15.201211 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:15.201476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] PATH_INFO: `/v3/users/5ad6327a68bf4e98a7c08a1b1711d415` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:15.202588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad6327a68bf4e98a7c08a1b1711d415)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:15.204504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:15.260184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad6327a68bf4e98a7c08a1b1711d415'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:15.273019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad6327a68bf4e98a7c08a1b1711d415'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:15.280416 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad6327a68bf4e98a7c08a1b1711d415'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:15.291017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad6327a68bf4e98a7c08a1b1711d415'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:15.291643 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad6327a68bf4e98a7c08a1b1711d415'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:15.301071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1316/2667] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:15 2022] DELETE /identity/v3/users/5ad6327a68bf4e98a7c08a1b1711d415 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:15.305736 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:15.306236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:15.306349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:15.326423 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:15.327889 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:15.396698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1352/2668] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:15.407202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:15.408606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:15.438384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:15.481854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec292a1-ba9f-478c-890e-ef14a7f1b01a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:15.485890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:15.486574 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:15.486925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:15.487504 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:15.498756 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:15.500350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:15.514109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1317/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:15.906097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:15.907531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:15.920227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66c41-118a-4403-a44a-aeccee4b4296 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:15.926485 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:15.927161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:15.927447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:15.927779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] PATH_INFO: `/v3/projects/5aa817c7086a42c2ad240acc406dcba0` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:15.928846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa817c7086a42c2ad240acc406dcba0)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:15.932935 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:15.993141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa817c7086a42c2ad240acc406dcba0', 'request_id': 'req-e0b206f6-7cda-40d7-adc7-a49897edce04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.000933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa817c7086a42c2ad240acc406dcba0', 'request_id': 'req-e0b206f6-7cda-40d7-adc7-a49897edce04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.007286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa817c7086a42c2ad240acc406dcba0', 'request_id': 'req-e0b206f6-7cda-40d7-adc7-a49897edce04'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.017382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] The token cache is being invalidate because project 5aa817c7086a42c2ad240acc406dcba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:16.017665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.018283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.019783 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1353/2670] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:15 2022] DELETE /identity/v3/projects/5aa817c7086a42c2ad240acc406dcba0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:16.023938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.033501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90951c-5e02-4f37-ad78-e8196f35974e service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.090635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.091304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.091602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.091855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] PATH_INFO: `/v3/users/2820c80c41704d3f8def99a037b2c3c9` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.092959 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2820c80c41704d3f8def99a037b2c3c9)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.094870 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.142880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2820c80c41704d3f8def99a037b2c3c9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.155210 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2820c80c41704d3f8def99a037b2c3c9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.161913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2820c80c41704d3f8def99a037b2c3c9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.169914 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2820c80c41704d3f8def99a037b2c3c9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.170558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-7d463a27-041b-4602-ac68-0884ba2e7a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2820c80c41704d3f8def99a037b2c3c9'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.177002 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1318/2671] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:16 2022] DELETE /identity/v3/users/2820c80c41704d3f8def99a037b2c3c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:16.461244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.464146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:16.478476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b206f6-7cda-40d7-adc7-a49897edce04 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.526910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:16.541775 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.542413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.542694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.542970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] PATH_INFO: `/v3/projects/480078a19cf94013bec8fa1ba3161a83` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.544180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=480078a19cf94013bec8fa1ba3161a83)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.546130 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.594923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480078a19cf94013bec8fa1ba3161a83', 'request_id': 'req-6599045c-206e-42db-b69d-9477695d52ec'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.602867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480078a19cf94013bec8fa1ba3161a83', 'request_id': 'req-6599045c-206e-42db-b69d-9477695d52ec'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.609758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480078a19cf94013bec8fa1ba3161a83', 'request_id': 'req-6599045c-206e-42db-b69d-9477695d52ec'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.620954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] The token cache is being invalidate because project 480078a19cf94013bec8fa1ba3161a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:16.621245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.621915 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6599045c-206e-42db-b69d-9477695d52ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:16.623457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1354/2672] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:16 2022] DELETE /identity/v3/projects/480078a19cf94013bec8fa1ba3161a83 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:16.628401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.628689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.628963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.649412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:16.650700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:16.692614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:16.714384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1319/2673] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:16.722264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.722548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.722821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.742913 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:16.744163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:16.752246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1355/2674] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:16.756790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.767200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e38578-cfd8-4b2c-bf5f-31d22218a12d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.771783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.772367 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.772646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.772915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.774314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:16.774617 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.776262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.788216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1320/2675] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:16.795335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.805481 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3dcb4-18fb-46b5-9808-e28b79028cfc None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.813644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.814258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.814543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.814808 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.815482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.817453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.850612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1356/2676] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:16 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:16.852866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.863631 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820b42-24b6-411f-97e9-6dab8a359638 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.924058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.924718 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.924994 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.925265 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.925924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.927896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.954270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1321/2677] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:16 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:16.958347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:16.975954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9741ce-4fad-48fe-87b6-85005a2da62b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:16.976116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:16.977308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:16.977583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:16.977852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:16.978500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:16.980169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:16.990523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1357/2678] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:16.996118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.010074 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ab62c-65a2-4f6c-a572-a0ec41009baa admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.015421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.016065 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.016350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.016630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.017281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.018970 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39c894-2da1-47e2-b417-8dcce5cb8c6f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.030696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1322/2679] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:17.034793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.045304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b21a-88eb-4370-9149-9b436c006230 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.050143 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.050869 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.051250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.051626 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] PATH_INFO: `/v3/projects/724b713586614ee1ab1c78f120cfe89f/users/d0e8147e1c7b44f79999e9c7642362a1/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.070822 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724b713586614ee1ab1c78f120cfe89f, user_id=d0e8147e1c7b44f79999e9c7642362a1, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.073546 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.088422 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1358/2680] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:17 2022] PUT /identity/v3/projects/724b713586614ee1ab1c78f120cfe89f/users/d0e8147e1c7b44f79999e9c7642362a1/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:17.099846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.100133 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.100408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.131054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] MFA Rules not processed for user `d0e8147e1c7b44f79999e9c7642362a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:17.132378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:17.200953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1323/2681] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:17.205494 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.269056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7fe90-83fe-420a-b6fc-e656756ef6d5 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.274441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.275071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.275355 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.275628 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.276256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.278161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.300115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:17.307378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1359/2682] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:17 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:17.311488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.322739 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422fd11-e855-4095-9dad-c8b8af9aa2cc None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.363324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:17.383821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.384427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.384708 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.384980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.385618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.387546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.414956 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1324/2683] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:17 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:17.416906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.427177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5c639-66c7-4fbb-ad8a-80c1ff3f05f0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.432170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.433325 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.433570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.433975 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.434685 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.436429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.449253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1360/2684] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:17.455953 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.466958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10f8bb-1aad-4a57-add2-1244bf0e60a0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.471558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.472197 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.472474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.472748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] PATH_INFO: `/v3/projects/0849199deeff43d99417b2808ad984e5/users/924768bda86144fd904f21c5c1263183/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.490885 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0849199deeff43d99417b2808ad984e5, user_id=924768bda86144fd904f21c5c1263183, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.493766 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.506636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1325/2685] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:17 2022] PUT /identity/v3/projects/0849199deeff43d99417b2808ad984e5/users/924768bda86144fd904f21c5c1263183/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:17.511769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.521705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727ab6-5608-4ba1-b24c-1404f7e5a5f9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.578379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.579012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.579301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.579575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.580216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.581841 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f052b-572c-4feb-a4ed-9a7ccf55055d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.592478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1361/2686] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:17.596636 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.606862 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2317b0-8d8c-4142-81f6-b30007944031 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.611482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.612132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.612418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.612696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] PATH_INFO: `/v3/projects/0849199deeff43d99417b2808ad984e5/users/924768bda86144fd904f21c5c1263183/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.614620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0849199deeff43d99417b2808ad984e5, user_id=924768bda86144fd904f21c5c1263183, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.617369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.628469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1326/2687] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:17 2022] PUT /identity/v3/projects/0849199deeff43d99417b2808ad984e5/users/924768bda86144fd904f21c5c1263183/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:17.639229 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.639521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.639799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.668676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] MFA Rules not processed for user `924768bda86144fd904f21c5c1263183`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:17.669890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:17.737998 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1362/2688] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:17.751171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:17.752908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:17.811598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314feb-b974-43fc-9818-b343dd49dac7 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:17.815262 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:17.815865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:17.816149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:17.816424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:17.825972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:17.827437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:17.837153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1327/2689] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:18.192038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:18.207963 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9967c3-3571-4dbf-9677-8990e8570800 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:18.214009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924768bda86144fd904f21c5c1263183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0849199deeff43d99417b2808ad984e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:18.214713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:18.215029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:18.217284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:18.218005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:18.218318 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:18.220098 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:18.241708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1363/2690] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:18.242857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:18.264288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae950-e538-43dc-8605-c7f18a38052a service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:18.270777 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924768bda86144fd904f21c5c1263183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0849199deeff43d99417b2808ad984e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:18.271673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:18.272027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:18.272394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:18.273793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:18.276340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:18.309372 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1328/2691] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:18 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:18.313601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:18.326409 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4441495-56a4-490c-89bb-8ae126775112 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:18.398911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=100 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:18.408579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924768bda86144fd904f21c5c1263183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0849199deeff43d99417b2808ad984e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:18.409194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:18.409474 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:18.410528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:18.410528 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:18.410734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:18.412315 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:18.427274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1364/2692] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:23:18.478772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:18.496449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6142d90-0cd9-4528-b197-6ab5279ad88c tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:18.502624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924768bda86144fd904f21c5c1263183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0849199deeff43d99417b2808ad984e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:18.506310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:18.506620 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:18.506906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] PATH_INFO: `/v3/projects/cbc45e081bc0485a86c06f02ff71f54e` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:18.508957 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cbc45e081bc0485a86c06f02ff71f54e)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:18.510878 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:18.581387 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc45e081bc0485a86c06f02ff71f54e', 'request_id': 'req-3d176d7f-70f7-4e99-b68e-f91ff3da4203'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:18.590087 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc45e081bc0485a86c06f02ff71f54e', 'request_id': 'req-3d176d7f-70f7-4e99-b68e-f91ff3da4203'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:18.596673 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc45e081bc0485a86c06f02ff71f54e', 'request_id': 'req-3d176d7f-70f7-4e99-b68e-f91ff3da4203'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:18.599699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:18.619834 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] The token cache is being invalidate because project cbc45e081bc0485a86c06f02ff71f54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:18.620874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:18.621738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3d176d7f-70f7-4e99-b68e-f91ff3da4203 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:18.623436 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1329/2693] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:18 2022] DELETE /identity/v3/projects/cbc45e081bc0485a86c06f02ff71f54e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:18.883648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:18.888492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:18.984342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696be7-c1b7-458d-8688-f86a04deb0c7 tempest-VolumeQuotaClassesTest-9897121 tempest-VolumeQuotaClassesTest-9897121-project-admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:19.044758 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:19.045306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:19.045639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:19.045866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] PATH_INFO: `/v3/users/d0e8147e1c7b44f79999e9c7642362a1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:19.047140 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e8147e1c7b44f79999e9c7642362a1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:19.053248 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:19.112886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e8147e1c7b44f79999e9c7642362a1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.121306 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e8147e1c7b44f79999e9c7642362a1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.130213 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e8147e1c7b44f79999e9c7642362a1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.131080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e8147e1c7b44f79999e9c7642362a1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.156542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e8147e1c7b44f79999e9c7642362a1'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.163174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1365/2694] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:18 2022] DELETE /identity/v3/users/d0e8147e1c7b44f79999e9c7642362a1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:19.168004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:19.168294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:19.168598 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:19.197103 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:19.199270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:19.297252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1330/2695] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:19.309875 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:19.311730 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:19.346471 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:19.439346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4918-8e35-4503-a2a0-a54d4688f139 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:19.448323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:19.449356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:19.449989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:19.451381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:19.466522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:19.468523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:19.496778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1366/2696] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:23:19.884304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:19.884965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:19.897554 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb591-a8e8-44ab-84f7-af5f708ca5bb None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:19.903166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:19.904497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:19.904876 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:19.905254 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] PATH_INFO: `/v3/projects/724b713586614ee1ab1c78f120cfe89f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:19.906578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724b713586614ee1ab1c78f120cfe89f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:19.908782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:19.961188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724b713586614ee1ab1c78f120cfe89f', 'request_id': 'req-c2039467-584c-4753-9b70-f0bc85eab944'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.972659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724b713586614ee1ab1c78f120cfe89f', 'request_id': 'req-c2039467-584c-4753-9b70-f0bc85eab944'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.982699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724b713586614ee1ab1c78f120cfe89f', 'request_id': 'req-c2039467-584c-4753-9b70-f0bc85eab944'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.996102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] The token cache is being invalidate because project 724b713586614ee1ab1c78f120cfe89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:19.996401 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.997287 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-c2039467-584c-4753-9b70-f0bc85eab944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:19.998924 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1331/2697] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:19 2022] DELETE /identity/v3/projects/724b713586614ee1ab1c78f120cfe89f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:20.002752 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:20.013958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd5a7-1974-4b0b-b181-278a6b485d28 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:20.085671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:20.086314 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.086598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.087026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] PATH_INFO: `/v3/users/924768bda86144fd904f21c5c1263183` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.088496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924768bda86144fd904f21c5c1263183)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:20.090590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:20.152976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924768bda86144fd904f21c5c1263183'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.160748 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924768bda86144fd904f21c5c1263183'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.168707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924768bda86144fd904f21c5c1263183'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.169493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924768bda86144fd904f21c5c1263183'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.183434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924768bda86144fd904f21c5c1263183'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.189848 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1367/2698] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:20 2022] DELETE /identity/v3/users/924768bda86144fd904f21c5c1263183 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:20.487260 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dcbb-a464-4ad3-8f5f-35bbcc216f38 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.487725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dcbb-a464-4ad3-8f5f-35bbcc216f38 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.487839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dcbb-a464-4ad3-8f5f-35bbcc216f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.496513 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:20.498110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:20.516200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3ef9dcbb-a464-4ad3-8f5f-35bbcc216f38 None None] MFA Rules not processed for user `b41ae60ee987459cb0d37ec80e85efa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:20.517424 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3ef9dcbb-a464-4ad3-8f5f-35bbcc216f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:20.556218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:20.582731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d785543-47b7-4914-b455-91b7aa12bf10 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:20.585265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:20.586005 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.586282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.586550 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] PATH_INFO: `/v3/projects/0849199deeff43d99417b2808ad984e5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.587705 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0849199deeff43d99417b2808ad984e5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:20.589615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:20.592774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1332/2699] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:20.642003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0849199deeff43d99417b2808ad984e5', 'request_id': 'req-468b630f-8a4b-403e-8e10-ba8e4d7df380'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.654089 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0849199deeff43d99417b2808ad984e5', 'request_id': 'req-468b630f-8a4b-403e-8e10-ba8e4d7df380'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.662350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0849199deeff43d99417b2808ad984e5', 'request_id': 'req-468b630f-8a4b-403e-8e10-ba8e4d7df380'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.686214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] The token cache is being invalidate because project 0849199deeff43d99417b2808ad984e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:20.686514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.687330 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-468b630f-8a4b-403e-8e10-ba8e4d7df380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:20.690303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1368/2700] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:20 2022] DELETE /identity/v3/projects/0849199deeff43d99417b2808ad984e5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:20.694346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.694630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.695006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.716468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:20.719175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:20.743768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:20.802411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1333/2701] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:20.811919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.812496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.813191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.843562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:20.844726 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:20.854872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1369/2702] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:20.858801 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:20.870093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f460b5-3b4e-4ac9-a5ba-6c8d5e6d76a9 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:20.897868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:20.899635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.900007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.900338 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.901376 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:20.901760 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:20.903520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:20.923001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1334/2703] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:20.924029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:20.936175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6426-c096-48f8-a5ac-f126a5c4908a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:20.941382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:20.942016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:20.942267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:20.942537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:20.943962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:20.945169 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:20.986398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1370/2704] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:20 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:20.991102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.003241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457502dd-8706-4842-accc-a675ea58c445 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.076028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.076658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.078417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.078700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.079437 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.081400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.109285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1335/2705] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:20 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:21.110413 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.123189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945cfe-c8d6-48f9-8dfe-a46f90781932 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.128764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.129605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.130104 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.130577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.131453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.134087 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.146894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1371/2706] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:21.152018 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.163208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0306-b4b2-45cb-9202-c1f96a5e4309 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.172687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.173400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.173793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.174082 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.174817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.176512 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080f721-ed25-4711-a524-68794ffe892a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.188980 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1336/2707] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:21.193262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.208490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdad62-fc9f-40fa-bdd5-0291962ea9fc admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.217317 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.218359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.218830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.219322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] PATH_INFO: `/v3/projects/524b713079aa46b0a4db467dc805bfb8/users/3d057e73dc964f04bfef4f0f94912bd8/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.244622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524b713079aa46b0a4db467dc805bfb8, user_id=3d057e73dc964f04bfef4f0f94912bd8, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.247623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.275079 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1372/2708] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:21 2022] PUT /identity/v3/projects/524b713079aa46b0a4db467dc805bfb8/users/3d057e73dc964f04bfef4f0f94912bd8/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:21.286796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.287577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.287866 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.319026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] MFA Rules not processed for user `3d057e73dc964f04bfef4f0f94912bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:21.321629 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:21.407026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1337/2709] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:21.412086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.494109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639d039-9072-4c46-911a-ce49de44b753 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.504722 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.505562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.505990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.506275 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.506917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.509721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.521747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:21.550226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1373/2710] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:21 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:21.553855 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.567215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3485-8392-44bb-b92d-385f010f8f61 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.593995 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:21.650391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.651171 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.651490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.651829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.652641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.654897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.687124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.687447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1338/2711] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:21 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:21.699134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd00c2-157e-4230-86fb-f35f67465813 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.703994 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.704667 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.704958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.705298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.706045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.708175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.722292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1374/2712] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:21.727249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.739434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933905b-453c-4bf5-941f-6c1e5d2ef8b9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.745682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.746619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.746911 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.747618 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] PATH_INFO: `/v3/projects/b3157cc0238649b189868fc911509f1d/users/d2348c7c50e24740a6b258611adabae7/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.764907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3157cc0238649b189868fc911509f1d, user_id=d2348c7c50e24740a6b258611adabae7, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.767712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.782543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1339/2713] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:21 2022] PUT /identity/v3/projects/b3157cc0238649b189868fc911509f1d/users/d2348c7c50e24740a6b258611adabae7/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:21.786648 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.799507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f774f-b6c3-4575-bc19-9eb3e110a313 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.874511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.875451 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.875635 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.875890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.876538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.878196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e067c-e071-4e42-a7b4-da056c3fc81f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.891004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1375/2714] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:21.894764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:21.905301 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a847ed-f5af-4480-8c68-25856339067e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:21.910090 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:21.910742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.911119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.911399 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] PATH_INFO: `/v3/projects/b3157cc0238649b189868fc911509f1d/users/d2348c7c50e24740a6b258611adabae7/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.913313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3157cc0238649b189868fc911509f1d, user_id=d2348c7c50e24740a6b258611adabae7, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:21.916842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:21.927271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1340/2715] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:21 2022] PUT /identity/v3/projects/b3157cc0238649b189868fc911509f1d/users/d2348c7c50e24740a6b258611adabae7/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:21.938349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:21.938727 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:21.939101 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:21.967603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] MFA Rules not processed for user `d2348c7c50e24740a6b258611adabae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:21.968828 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:22.040768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1376/2716] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:22.052137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:22.053913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:22.111449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f417-0f9f-4173-82c7-9c1243e915ff admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:22.115067 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:22.115669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:22.115948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:22.116243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:22.126941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:22.128378 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaefa70-bda3-409f-8a2f-338c6ec109da service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:22.137899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1341/2717] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:22.571899 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:22.638038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026dd77-3fd3-428f-bd3f-4d202b3572cf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:22.642572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:22.643226 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:22.643509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:22.643786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] PATH_INFO: `/v3/users/3d057e73dc964f04bfef4f0f94912bd8` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:22.644925 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d057e73dc964f04bfef4f0f94912bd8)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:22.646832 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:22.650033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:22.696787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d057e73dc964f04bfef4f0f94912bd8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:22.704255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d057e73dc964f04bfef4f0f94912bd8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:22.713493 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d057e73dc964f04bfef4f0f94912bd8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:22.714171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d057e73dc964f04bfef4f0f94912bd8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:22.730362 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d057e73dc964f04bfef4f0f94912bd8'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:22.736932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1377/2718] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:22 2022] DELETE /identity/v3/users/3d057e73dc964f04bfef4f0f94912bd8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:22.741331 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:22.741934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:22.742077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:22.761720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:22.762942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:22.851115 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1342/2719] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:22.860224 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:22.860976 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:22.935525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc2c36-970f-4b55-ba3e-c311785276f9 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:22.951789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:22.952452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:22.952735 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:22.953009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:22.965245 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:22.968448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:22.980902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1378/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:23.310390 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:23.312348 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:23.326792 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234d25-03f3-47c4-b7f8-fd15efb0520d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:23.332225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:23.332872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:23.333148 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:23.333419 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] PATH_INFO: `/v3/projects/524b713079aa46b0a4db467dc805bfb8` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:23.334552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524b713079aa46b0a4db467dc805bfb8)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:23.337311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:23.352691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:23.393614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524b713079aa46b0a4db467dc805bfb8', 'request_id': 'req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.403585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524b713079aa46b0a4db467dc805bfb8', 'request_id': 'req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.409249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524b713079aa46b0a4db467dc805bfb8', 'request_id': 'req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.420720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] The token cache is being invalidate because project 524b713079aa46b0a4db467dc805bfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:23.420932 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.421577 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.423290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1343/2721] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:23 2022] DELETE /identity/v3/projects/524b713079aa46b0a4db467dc805bfb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:23.427110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:23.437296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f5073-451c-4f39-a850-4698fe7ac75c service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:23.496416 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:23.497054 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:23.497335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:23.497640 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] PATH_INFO: `/v3/users/d2348c7c50e24740a6b258611adabae7` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:23.498867 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2348c7c50e24740a6b258611adabae7)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:23.500813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:23.536156 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:23.560276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2348c7c50e24740a6b258611adabae7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.568016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2348c7c50e24740a6b258611adabae7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.576570 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2348c7c50e24740a6b258611adabae7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.577589 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2348c7c50e24740a6b258611adabae7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.590033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2348c7c50e24740a6b258611adabae7'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:23.596123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1379/2722] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:23 2022] DELETE /identity/v3/users/d2348c7c50e24740a6b258611adabae7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:23.906755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:23.909172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:23.925236 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bf2f4-295f-4bb2-92a6-7b342e9cf234 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:23.991678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:23.992384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:23.992796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:23.993137 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] PATH_INFO: `/v3/projects/b3157cc0238649b189868fc911509f1d` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:23.994349 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3157cc0238649b189868fc911509f1d)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:23.996791 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.053978 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3157cc0238649b189868fc911509f1d', 'request_id': 'req-e03196e6-2bec-4766-9c87-a05ffa614ffd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:24.067918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3157cc0238649b189868fc911509f1d', 'request_id': 'req-e03196e6-2bec-4766-9c87-a05ffa614ffd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:24.073437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.075521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:24.076123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3157cc0238649b189868fc911509f1d', 'request_id': 'req-e03196e6-2bec-4766-9c87-a05ffa614ffd'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:24.089029 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] The token cache is being invalidate because project b3157cc0238649b189868fc911509f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:24.089322 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:24.089971 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-e03196e6-2bec-4766-9c87-a05ffa614ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:24.091570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1344/2723] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:23 2022] DELETE /identity/v3/projects/b3157cc0238649b189868fc911509f1d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:24.097079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e6d5-fc82-4789-b584-7ab2d4ad16ab None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.097371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e6d5-fc82-4789-b584-7ab2d4ad16ab None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.097647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e6d5-fc82-4789-b584-7ab2d4ad16ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.118282 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-5f72e6d5-fc82-4789-b584-7ab2d4ad16ab None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:24.119566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5f72e6d5-fc82-4789-b584-7ab2d4ad16ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:24.145704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1cf1d-e54f-4b72-b6c7-9b06cb8c3395 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.149499 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:24.193110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1345/2724] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:24.202633 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.203307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.204787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.205097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.207289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:24.223634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.225124 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.238225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1380/2725] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:24.259781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.260106 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.260377 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.281694 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:24.282920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:24.294193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1346/2726] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:24.295458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.306274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa386-89a8-4881-b54f-3aa323d4b925 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.312699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.314163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.314647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.314846 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.315809 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:24.315957 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.317661 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.333110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1381/2727] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:24.338142 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.350821 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45c6e-6ca3-4f73-ba86-83a553370596 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.357010 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.357785 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.358153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.358546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.359403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.361524 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.392079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1347/2728] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:24.396457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.408149 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878090d2-099b-4090-894d-39967fea9424 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.458206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:24.472930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.473561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.473836 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.474110 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.474740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.476890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.500412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1382/2729] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:24.504497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.515535 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0c5ae-be06-4e7c-8a0e-5eb687b507f3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.520149 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.520752 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.521027 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.521298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.521944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.523732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.534172 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1348/2730] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:24.537959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.548096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec4a1-997a-4e09-8a8d-14596c80c26d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.553636 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.554797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.555177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.555444 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.556094 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.557704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f614d-69c3-4d7a-83ad-7987d25daac2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.569601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1383/2731] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:24.574726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.584560 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c578-5290-4239-a61f-0b6736591f17 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.589625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.590272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.590556 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.590831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] PATH_INFO: `/v3/projects/e30887dd99de4af0baaa5e89b2796e92/users/b1f0364f46ad4948bb4b2051c06fde01/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.605494 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30887dd99de4af0baaa5e89b2796e92, user_id=b1f0364f46ad4948bb4b2051c06fde01, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.608178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.625015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1349/2732] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:24 2022] PUT /identity/v3/projects/e30887dd99de4af0baaa5e89b2796e92/users/b1f0364f46ad4948bb4b2051c06fde01/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:24.637006 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65573-4306-490f-83fa-d329a8785717 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.637543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65573-4306-490f-83fa-d329a8785717 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.637543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65573-4306-490f-83fa-d329a8785717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.665324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fba65573-4306-490f-83fa-d329a8785717 None None] MFA Rules not processed for user `b1f0364f46ad4948bb4b2051c06fde01`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:24.666779 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fba65573-4306-490f-83fa-d329a8785717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:24.732343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1384/2733] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:24.736619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.804539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d11aa-8c3f-4232-acf7-956cc3ced3d4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.809646 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.810359 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.810704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.811079 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.811790 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.813845 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.855307 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1350/2734] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:24.859837 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba65573-4306-490f-83fa-d329a8785717 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:24.871880 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba65573-4306-490f-83fa-d329a8785717 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:24.943593 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:24.944380 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:24.944807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:24.945174 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:24.945928 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:24.948225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:24.990605 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1385/2735] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:24 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:24.994967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.007011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bfdf-d750-4f04-816c-fb5ba01ca4b9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.016501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.017215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.017680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.018717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.019784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.022268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.036434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1351/2736] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:25.040962 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.060356 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a83550-4398-4d2b-a464-5dc5c3988363 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.075350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.076284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.076721 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.077172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] PATH_INFO: `/v3/projects/8f56a0255273492b8776ac027fdd60e9/users/fcc45cab9ee045648a853d1f1737fc48/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.103683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f56a0255273492b8776ac027fdd60e9, user_id=fcc45cab9ee045648a853d1f1737fc48, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.106566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.128473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1386/2737] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:25 2022] PUT /identity/v3/projects/8f56a0255273492b8776ac027fdd60e9/users/fcc45cab9ee045648a853d1f1737fc48/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:25.132409 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.157237 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1152-9a71-4be7-8fe0-ffbb9fa53fad admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.203851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:25.249290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.249963 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.250256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.250896 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.251713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.253418 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf887997-1b6b-42ca-8a95-6b6be884983e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.276587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1352/2738] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:25.282141 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.295282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ba40-5fcc-441a-a358-f55272a6186c admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.308591 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.309262 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.309539 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.309810 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] PATH_INFO: `/v3/projects/8f56a0255273492b8776ac027fdd60e9/users/fcc45cab9ee045648a853d1f1737fc48/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.315670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f56a0255273492b8776ac027fdd60e9, user_id=fcc45cab9ee045648a853d1f1737fc48, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.318514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.330677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1387/2739] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:25 2022] PUT /identity/v3/projects/8f56a0255273492b8776ac027fdd60e9/users/fcc45cab9ee045648a853d1f1737fc48/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:25.343797 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.350229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.350611 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.400720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] MFA Rules not processed for user `fcc45cab9ee045648a853d1f1737fc48`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:25.402268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:25.552229 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1353/2740] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:25.565553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.571708 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:25.596242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:25.680543 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef850-5bff-47bb-a792-b5160300d8e7 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.685653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.686212 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.686490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.686768 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.698293 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.700753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.713515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1388/2741] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:25.792213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:25.801941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1181d6-4c5b-44a4-9ce2-8502b6130322 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:25.805639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:25.806243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:25.806523 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:25.806847 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:25.868075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:25.869529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d028-ff67-4d41-b8aa-c135b19beba3 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:25.879353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1354/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:26.177172 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:26.247801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946e46-b269-4d31-be92-1fd0a3ced217 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:26.258807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:26.260219 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:26.260696 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:26.261050 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] PATH_INFO: `/v3/users/b1f0364f46ad4948bb4b2051c06fde01` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:26.262689 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f0364f46ad4948bb4b2051c06fde01)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:26.265359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:26.335632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f0364f46ad4948bb4b2051c06fde01'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:26.346595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f0364f46ad4948bb4b2051c06fde01'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:26.357729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f0364f46ad4948bb4b2051c06fde01'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:26.358818 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f0364f46ad4948bb4b2051c06fde01'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:26.374109 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f0364f46ad4948bb4b2051c06fde01'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:26.381981 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1389/2743] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:26 2022] DELETE /identity/v3/users/b1f0364f46ad4948bb4b2051c06fde01 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:26.386743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:26.387351 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:26.387453 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:26.409846 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:26.411157 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:26.472584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=100 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:26.483281 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1355/2744] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:26.495642 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:26.497637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:26.535267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:26.563609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78f197-0ca7-4151-ab22-0f65f35c7d77 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:26.568531 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:26.569123 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:26.569478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:26.569879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:26.580238 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:26.581767 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:26.593296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1390/2745] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:26.969483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:26.971164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:26.986713 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bc5bc-8eeb-4679-8857-47d8b53044c0 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:26.992569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:26.993448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:26.993852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:26.994215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] PATH_INFO: `/v3/projects/e30887dd99de4af0baaa5e89b2796e92` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:26.996033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30887dd99de4af0baaa5e89b2796e92)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:26.999784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:27.063064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30887dd99de4af0baaa5e89b2796e92', 'request_id': 'req-8fd1d085-b521-4094-a7e8-545190dc32c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.074688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30887dd99de4af0baaa5e89b2796e92', 'request_id': 'req-8fd1d085-b521-4094-a7e8-545190dc32c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.083078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30887dd99de4af0baaa5e89b2796e92', 'request_id': 'req-8fd1d085-b521-4094-a7e8-545190dc32c5'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.096226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] The token cache is being invalidate because project e30887dd99de4af0baaa5e89b2796e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:27.096515 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.097180 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.098904 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1356/2746] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:26 2022] DELETE /identity/v3/projects/e30887dd99de4af0baaa5e89b2796e92 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:27.103134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:27.114163 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363fe1-0730-44f1-bbd1-2bf49184ee68 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:27.208616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:27.209327 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:27.209616 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:27.209892 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] PATH_INFO: `/v3/users/fcc45cab9ee045648a853d1f1737fc48` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:27.214575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc45cab9ee045648a853d1f1737fc48)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:27.217201 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:27.286622 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc45cab9ee045648a853d1f1737fc48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.294127 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc45cab9ee045648a853d1f1737fc48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.307564 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc45cab9ee045648a853d1f1737fc48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.308992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc45cab9ee045648a853d1f1737fc48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.324256 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc45cab9ee045648a853d1f1737fc48'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:27.334227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1391/2747] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:27 2022] DELETE /identity/v3/users/fcc45cab9ee045648a853d1f1737fc48 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:28.039093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:28.040851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:28.068901 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d085-b521-4094-a7e8-545190dc32c5 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:28.181355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:28.181941 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:28.182219 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:28.182464 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] PATH_INFO: `/v3/projects/8f56a0255273492b8776ac027fdd60e9` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:28.184395 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f56a0255273492b8776ac027fdd60e9)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:28.186874 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:28.248789 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f56a0255273492b8776ac027fdd60e9', 'request_id': 'req-2390e912-2f66-4a12-9cb0-3ab0f092984a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.267508 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f56a0255273492b8776ac027fdd60e9', 'request_id': 'req-2390e912-2f66-4a12-9cb0-3ab0f092984a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.284084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f56a0255273492b8776ac027fdd60e9', 'request_id': 'req-2390e912-2f66-4a12-9cb0-3ab0f092984a'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.296740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] The token cache is being invalidate because project 8f56a0255273492b8776ac027fdd60e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:28.297034 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.297704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.299619 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1357/2748] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:28 2022] DELETE /identity/v3/projects/8f56a0255273492b8776ac027fdd60e9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:28.336049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:28.338912 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:28.418335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:28.448382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:28.448760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd245ff-b082-4899-b1cf-4b6654655e37 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:28.450328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:28.478280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:28.543095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061616be-1085-4241-a07f-1768a9856033 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:28.543806 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061616be-1085-4241-a07f-1768a9856033 service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:28.544191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061616be-1085-4241-a07f-1768a9856033 service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:28.544560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061616be-1085-4241-a07f-1768a9856033 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:28.546597 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-061616be-1085-4241-a07f-1768a9856033 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:28.553316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e912-2f66-4a12-9cb0-3ab0f092984a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:28.558166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:28.558829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:28.559144 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:28.559586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] PATH_INFO: `/v3/users/1080f0e19dd84503af28318412466485` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:28.560796 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1080f0e19dd84503af28318412466485)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:28.561247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061616be-1085-4241-a07f-1768a9856033 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:28.562722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:28.563100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061616be-1085-4241-a07f-1768a9856033 service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:28.575746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1392/2749] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:28.613890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1080f0e19dd84503af28318412466485'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.626048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1080f0e19dd84503af28318412466485'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.633457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1080f0e19dd84503af28318412466485'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.641078 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1080f0e19dd84503af28318412466485'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.641809 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-1d980e6c-054c-4fb5-a3e0-f8dab44cbc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1080f0e19dd84503af28318412466485'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.647580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1358/2750] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:28 2022] DELETE /identity/v3/users/1080f0e19dd84503af28318412466485 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:28.823677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061616be-1085-4241-a07f-1768a9856033 service placement] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:28.844260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061616be-1085-4241-a07f-1768a9856033 service placement] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:28.907873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:28.908521 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:28.908802 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:28.909077 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] PATH_INFO: `/v3/projects/74e04e19bc1045a2adfbaa3d7c881fd1` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:28.910242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e04e19bc1045a2adfbaa3d7c881fd1)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:28.912195 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:28.970278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e04e19bc1045a2adfbaa3d7c881fd1', 'request_id': 'req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.982116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e04e19bc1045a2adfbaa3d7c881fd1', 'request_id': 'req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:28.989770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e04e19bc1045a2adfbaa3d7c881fd1', 'request_id': 'req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:29.001138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] The token cache is being invalidate because project 74e04e19bc1045a2adfbaa3d7c881fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:29.001577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:29.002269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-f1ba6a7b-d5d3-48ba-9ad5-e9303a632797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:29.004160 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1393/2751] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:28 2022] DELETE /identity/v3/projects/74e04e19bc1045a2adfbaa3d7c881fd1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:29.008780 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.009068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.009342 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.029225 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:29.030439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:29.103212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1359/2752] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:29.109603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.109923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.110199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.133097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:29.134459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:29.150590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1394/2753] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:29.154888 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.171037 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85281-9b13-4b09-9a47-e2a3744030c7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.178047 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.178678 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.179596 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.180369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.180563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:29.180802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.182415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.195541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1360/2754] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:29.201215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.214167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ee89-47fd-440a-9e04-28f1cf800557 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.219842 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.220534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.220894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.221228 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.221958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.224105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.231780 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:29.263958 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1395/2755] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:29 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:29.267890 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.280656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0aa9-2b15-4468-8a2b-1d53bfd37679 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.301530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:29.352639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.353165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.353719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.353719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.354468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.356451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.380364 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1361/2756] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:29 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:29.385180 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.395793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b551-58a1-4cad-b823-465dd410e32b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.400496 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.401091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.401377 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.401646 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.402280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.403910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.414800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1396/2757] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:29.419194 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.431123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5ee6-9218-4d08-8006-a9d56c90a022 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.435768 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.436360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.436736 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.437021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.437662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.439292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e2091-de3e-44df-a2a8-4f00bb932432 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.450055 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1362/2758] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:29.454265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.464594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7cf3-0de8-492f-8f64-cf1449e304da admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.469261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.469907 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.470189 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.470463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] PATH_INFO: `/v3/projects/e414e29e857a4493bfc4620e3b0ad201/users/79fcf355ccf6456295c1df45349f1574/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.485488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e414e29e857a4493bfc4620e3b0ad201, user_id=79fcf355ccf6456295c1df45349f1574, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.488199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.502704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1397/2759] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:29 2022] PUT /identity/v3/projects/e414e29e857a4493bfc4620e3b0ad201/users/79fcf355ccf6456295c1df45349f1574/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:29.513184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.513470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.513748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.541506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] MFA Rules not processed for user `79fcf355ccf6456295c1df45349f1574`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:29.542754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:29.605929 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1363/2760] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:29.617247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:29.619086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:29.675829 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ee3bf-a202-4a58-a55f-f8140488a643 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:29.680175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:29.680773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:29.681052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:29.681322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:29.689375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:29.690796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49abc-6519-4e6a-8510-f054d1220a83 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:29.699734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1398/2761] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:30.309337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:30.310721 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:30.377071 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ea45b-4657-40fb-8d96-d5532d3b7286 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:30.381546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:30.383167 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:30.383450 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:30.383725 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] PATH_INFO: `/v3/users/b77abd336958480099d36e3e9d1ec56b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:30.384842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77abd336958480099d36e3e9d1ec56b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:30.386749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:30.421481 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:30.437200 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77abd336958480099d36e3e9d1ec56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:30.450954 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77abd336958480099d36e3e9d1ec56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:30.457719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77abd336958480099d36e3e9d1ec56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:30.465097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77abd336958480099d36e3e9d1ec56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:30.465745 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77abd336958480099d36e3e9d1ec56b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:30.471948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1364/2762] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:30 2022] DELETE /identity/v3/users/b77abd336958480099d36e3e9d1ec56b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:30.476744 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:30.477205 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:30.477301 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:30.496615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:30.497823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:30.557778 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1399/2763] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:30.567558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:30.568982 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:30.631669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c6e9-294a-4cc6-9743-44b0b6afbc18 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:30.635595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:30.636208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:30.636483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:30.636753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:30.646243 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:30.648191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648183-ccc0-4528-a9ae-c7a2b6d61e7c service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:30.658059 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1365/2764] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:30.926886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:30.928442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:30.940586 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceaa0b-353b-48a5-ad32-f595644661f4 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:30.945684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:30.946311 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:30.946590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:30.946861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] PATH_INFO: `/v3/projects/bb98eee2270e47aba61d25583249e0f2` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:30.948019 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb98eee2270e47aba61d25583249e0f2)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:30.949926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:30.998852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb98eee2270e47aba61d25583249e0f2', 'request_id': 'req-2c619779-dcc5-4c57-8217-46f35604a18f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:31.000548 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:31.009215 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb98eee2270e47aba61d25583249e0f2', 'request_id': 'req-2c619779-dcc5-4c57-8217-46f35604a18f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:31.017001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb98eee2270e47aba61d25583249e0f2', 'request_id': 'req-2c619779-dcc5-4c57-8217-46f35604a18f'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:31.028844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] The token cache is being invalidate because project bb98eee2270e47aba61d25583249e0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:31.029135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:31.029786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:31.031457 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1400/2765] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:30 2022] DELETE /identity/v3/projects/bb98eee2270e47aba61d25583249e0f2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:35.866212 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:35.866635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:35.867622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:35.893746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:35.894964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:35.953299 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1366/2766] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Aug 30 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:35.966023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:35.967592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:36.043924 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619779-dcc5-4c57-8217-46f35604a18f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:36.049274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:36.049877 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:36.050171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:36.050434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:36.060447 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:36.062133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a647f-8e8d-4f31-9651-ebf941fb8f99 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:36.070545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1401/2767] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:23:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:23:38.192294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:38.193346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:38.276124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:38.284898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab65ca-1fa1-41ca-a4d7-0f438faf2300 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:38.291967 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:38.292802 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:38.293186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:38.293568 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] PATH_INFO: `/v3/users/79fcf355ccf6456295c1df45349f1574` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:38.294859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fcf355ccf6456295c1df45349f1574)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:38.296906 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:38.362934 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fcf355ccf6456295c1df45349f1574'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:38.383981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fcf355ccf6456295c1df45349f1574'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:38.391873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fcf355ccf6456295c1df45349f1574'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:38.402354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fcf355ccf6456295c1df45349f1574'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:38.403480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fcf355ccf6456295c1df45349f1574'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:38.411719 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1367/2768] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:38 2022] DELETE /identity/v3/users/79fcf355ccf6456295c1df45349f1574 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:38.418291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:38.418819 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:38.419132 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:38.446056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:38.447359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:38.519553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1402/2769] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:38.530622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:38.532151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:38.596843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95cee0-e3f3-4f8d-8024-fc41fa138eb2 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:38.602711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:38.603601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:38.603887 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:38.604164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:38.620880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:38.622370 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca247bf-f45b-49d0-840d-654caf389f00 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:38.641048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1368/2770] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:38.948345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:38.950594 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:38.968307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b9ff-7ca3-45fb-8f51-e4d3703bfb86 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:38.977569 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:38.978237 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:38.978527 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:38.978777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] PATH_INFO: `/v3/projects/e414e29e857a4493bfc4620e3b0ad201` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:38.980037 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e414e29e857a4493bfc4620e3b0ad201)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:38.981990 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.053490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e414e29e857a4493bfc4620e3b0ad201', 'request_id': 'req-648998e1-3d45-4106-a272-b4347d9a342e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:39.063250 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e414e29e857a4493bfc4620e3b0ad201', 'request_id': 'req-648998e1-3d45-4106-a272-b4347d9a342e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:39.072043 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e414e29e857a4493bfc4620e3b0ad201', 'request_id': 'req-648998e1-3d45-4106-a272-b4347d9a342e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:39.074872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:39.085166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] The token cache is being invalidate because project e414e29e857a4493bfc4620e3b0ad201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:39.087013 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:39.087789 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-648998e1-3d45-4106-a272-b4347d9a342e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:39.090038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1403/2771] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:38 2022] DELETE /identity/v3/projects/e414e29e857a4493bfc4620e3b0ad201 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:39.095675 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.096085 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.096429 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.120684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:39.121895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:39.193787 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1369/2772] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:39.204410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.204713 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.204992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.236870 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:39.238107 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:39.252665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1404/2773] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:39.258772 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.269207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569aba9-3be5-4cf3-b7e2-027d12d013cd None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.274728 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.275516 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.275804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.276080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.276731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:39.277036 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.278727 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.293754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1370/2774] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:39.301137 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.312566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26609-0f10-4f13-a9a7-94f35bc19723 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.318029 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.318680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.318959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.319289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.319921 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.322443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.363032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1405/2775] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:39 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:39.366764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.376715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:39.381698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ad7b-8f9c-402c-99ae-43bd54fe9ae3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.451177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.452019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.452439 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.452848 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.453626 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.455767 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.485783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1371/2776] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:39 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:39.487435 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.500081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea909d0-b0a6-4ae7-a13b-fbe8823e1922 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.506157 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.506884 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.507240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.507657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.508862 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.510524 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.527023 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1406/2777] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:39.528879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.541722 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6f49-7c1f-410f-b16c-959bd6fa73fe admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.550060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.551279 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.551850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.552411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.553698 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.557513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb63ea-fc08-4957-b37a-facbcf36cfca admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.578807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1372/2778] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:39.582601 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.595491 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05aa97-fa25-4888-8088-8310b972e8a0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.600950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.602670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.603071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.603584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] PATH_INFO: `/v3/projects/2e8f0967ecb74505ae4f765e78ecf49d/users/5eeea08b5fee45e193e56f43ca504c49/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.620796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8f0967ecb74505ae4f765e78ecf49d, user_id=5eeea08b5fee45e193e56f43ca504c49, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.623614 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.649734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1407/2779] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:39 2022] PUT /identity/v3/projects/2e8f0967ecb74505ae4f765e78ecf49d/users/5eeea08b5fee45e193e56f43ca504c49/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:39.651567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.651852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.652140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.687585 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] MFA Rules not processed for user `5eeea08b5fee45e193e56f43ca504c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:39.688748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:39.778272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1373/2780] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:39.785830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:39.787821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:39.888170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2582f7f-bc9f-4ead-9356-dc627221acd4 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:39.894906 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:39.895657 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:39.896083 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:39.896384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:39.906715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:39.908477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087be40f-761c-4abf-b848-fac72d13106c service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:39.927186 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1408/2781] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:40.183743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:40.283480 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ad1e-2657-4691-ad3c-9105e8abb803 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:40.288288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:40.289716 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:40.290121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:40.290505 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] PATH_INFO: `/v3/users/5eeea08b5fee45e193e56f43ca504c49` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:40.292188 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eeea08b5fee45e193e56f43ca504c49)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:40.294264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:40.312587 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:40.355917 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eeea08b5fee45e193e56f43ca504c49'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:40.374176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eeea08b5fee45e193e56f43ca504c49'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:40.382337 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eeea08b5fee45e193e56f43ca504c49'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:40.391948 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eeea08b5fee45e193e56f43ca504c49'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:40.392738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eeea08b5fee45e193e56f43ca504c49'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:40.400017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1374/2782] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:40 2022] DELETE /identity/v3/users/5eeea08b5fee45e193e56f43ca504c49 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:40.405296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:40.405587 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:40.405894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:40.426441 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:40.427968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:40.493459 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1409/2783] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:40.504833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:40.507028 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:40.571291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915725fa-48e6-4244-aa13-fe52f704c8dd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:40.575408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:40.576153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:40.576551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:40.576909 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:40.587905 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:40.589677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b115-3071-47e1-ab18-42011b0ddbc6 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:40.600778 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1375/2784] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:40.914014 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:40.916561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:40.942501 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9c18-665a-41ec-8498-5d16bea517aa None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:40.951452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:40.952343 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:40.952725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:40.953102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] PATH_INFO: `/v3/projects/2e8f0967ecb74505ae4f765e78ecf49d` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:40.954777 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8f0967ecb74505ae4f765e78ecf49d)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:40.956845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:40.969985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:41.021404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8f0967ecb74505ae4f765e78ecf49d', 'request_id': 'req-ea233ddb-4243-4551-b5d7-6a71015f66ee'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:41.037795 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8f0967ecb74505ae4f765e78ecf49d', 'request_id': 'req-ea233ddb-4243-4551-b5d7-6a71015f66ee'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:41.050756 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8f0967ecb74505ae4f765e78ecf49d', 'request_id': 'req-ea233ddb-4243-4551-b5d7-6a71015f66ee'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:41.062769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] The token cache is being invalidate because project 2e8f0967ecb74505ae4f765e78ecf49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:41.063291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:41.064044 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea233ddb-4243-4551-b5d7-6a71015f66ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:41.068351 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1410/2785] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:40 2022] DELETE /identity/v3/projects/2e8f0967ecb74505ae4f765e78ecf49d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:41.073677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.073965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.074241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.097449 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:41.098567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:41.174202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1376/2786] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:41.182676 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.182959 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.183260 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.204974 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:41.206246 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:41.216693 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1411/2787] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:41.221193 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.232239 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a072-2caf-4e19-a0e0-f94b675462bd None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.237546 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.238183 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.238460 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.238733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.239443 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:41.239753 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.241421 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.258842 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1377/2788] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:41.264277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.275036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b87f-5769-4164-9ecc-fe478c40bbd2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.280153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.280873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.281308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.281639 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.282366 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.284609 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.319038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1412/2789] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:41 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:41.324247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.334651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f946-3df9-423a-8ef9-500ac09add1f admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.367784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:41.418738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.419530 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.419815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.420089 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.420738 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.422667 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.466550 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1378/2790] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:41 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:41.468053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.481059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cee34-d750-4362-b17e-8351b3377a38 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.486522 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.487197 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.487480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.487770 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.488408 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.490009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.503979 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1413/2791] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:41.510070 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.524654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7875d-19b7-4236-a936-c173851e10fb admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.529635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.530573 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.531086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.531548 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.532616 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.535311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b732a5-04d7-4d20-9bd1-b5f0f5ae0136 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.553208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1379/2792] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:41.554579 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.566268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d284c-0414-4f4a-adfb-fe2e8ab6d4a0 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.571792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.572728 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.573003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.573286 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] PATH_INFO: `/v3/projects/2387347f0fad448c91b488e057e5bdd1/users/6982e7f6ee78455098c45ffb5851bd1c/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.593384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2387347f0fad448c91b488e057e5bdd1, user_id=6982e7f6ee78455098c45ffb5851bd1c, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.596233 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.613183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1414/2793] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:41 2022] PUT /identity/v3/projects/2387347f0fad448c91b488e057e5bdd1/users/6982e7f6ee78455098c45ffb5851bd1c/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:41.620011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc7eb-0f2d-4009-8b97-75711d512a1b None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.620881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc7eb-0f2d-4009-8b97-75711d512a1b None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.621477 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc7eb-0f2d-4009-8b97-75711d512a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.646685 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-70edc7eb-0f2d-4009-8b97-75711d512a1b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:41.648174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-70edc7eb-0f2d-4009-8b97-75711d512a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:41.732490 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1380/2794] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:41.744760 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:41.746850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:41.822294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0ea1-93b2-4176-b11c-3db5609d66c2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:41.827298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:41.827909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:41.828190 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:41.828467 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:41.842300 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:41.843872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:41.856583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1415/2795] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:42.619961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:42.620962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:42.620962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:42.656681 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] MFA Rules not processed for user `6982e7f6ee78455098c45ffb5851bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:42.658021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:42.749129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1381/2796] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:42.753487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:42.765613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80223d-781e-4b08-8f95-7396e02aec90 service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:42.771151 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:42.773020 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:42.773489 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:42.774588 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:42.775438 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:42.778103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:42.817725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1416/2797] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:42 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:42.822507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:42.837803 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8cdbd-c0be-4741-a223-b511ec0b6994 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:42.879404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:42.920408 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:42.921092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:42.921393 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:42.921671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:42.922324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:42.924347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:42.958682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1382/2798] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:42 2022] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:42.963555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:42.976993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6a4c-f60d-45fd-82e3-624866ed9fc6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:42.982168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:42.982831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:42.983265 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:42.983596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:42.984655 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:42.986359 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:42.998973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1417/2799] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:43.003528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:43.014916 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9d18-2057-4da8-8f77-e9dd613e09f6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:43.019702 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:43.020357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:43.020633 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:43.020908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] PATH_INFO: `/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b/users/38eb5b706a264be5ae9f47c2386fef53/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:43.039825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e16d823a1fd4f3f88ce9cd863bf2e1b, user_id=38eb5b706a264be5ae9f47c2386fef53, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:43.042800 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:43.058669 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1383/2800] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:43 2022] PUT /identity/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b/users/38eb5b706a264be5ae9f47c2386fef53/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:43.062781 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:43.068035 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:43.076390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4e3af-889a-40cd-9332-bf23e25fd604 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:43.143552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:43.144194 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:43.144470 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:43.144739 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:43.145381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:43.146973 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8956-04bc-43fc-884b-92d05c1be543 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:43.158320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1418/2801] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:23:43.162116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:43.172749 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaeba0-cfa8-42aa-8842-785c4b32b349 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:43.180214 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:43.181469 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:43.181835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:43.182244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] PATH_INFO: `/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b/users/38eb5b706a264be5ae9f47c2386fef53/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:43.184278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e16d823a1fd4f3f88ce9cd863bf2e1b, user_id=38eb5b706a264be5ae9f47c2386fef53, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:43.186992 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:43.200244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1384/2802] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:43 2022] PUT /identity/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b/users/38eb5b706a264be5ae9f47c2386fef53/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:43.944515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:43.945090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:43.945090 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:43.982595 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] MFA Rules not processed for user `38eb5b706a264be5ae9f47c2386fef53`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:43.984102 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:44.103103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1419/2803] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:45.292644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:45.295398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:45.363615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:45.434614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753ecf-a635-4708-bd12-dac3aaa9b920 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:45.440316 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:45.440927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:45.441344 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:45.441644 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:45.446075 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:45.455304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a245c-2e12-45f2-9d41-fac3cc7d059a None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:45.460258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:45.461047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:45.461432 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:45.461801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] PATH_INFO: `/v3/users/6982e7f6ee78455098c45ffb5851bd1c` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:45.462829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:45.463577 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6982e7f6ee78455098c45ffb5851bd1c)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:45.464783 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:45.466191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:45.489118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1385/2804] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:23:45.503796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:45.533670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6982e7f6ee78455098c45ffb5851bd1c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.542659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6982e7f6ee78455098c45ffb5851bd1c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.551281 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6982e7f6ee78455098c45ffb5851bd1c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.551950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6982e7f6ee78455098c45ffb5851bd1c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.567119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6982e7f6ee78455098c45ffb5851bd1c'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.574429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1420/2805] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:45 2022] DELETE /identity/v3/users/6982e7f6ee78455098c45ffb5851bd1c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:45.769263 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:45.781637 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225e37-ac86-4169-b898-7db7a82a4254 service placement] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:45.862624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:45.863324 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:45.863606 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:45.863883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] PATH_INFO: `/v3/projects/2387347f0fad448c91b488e057e5bdd1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:45.865009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2387347f0fad448c91b488e057e5bdd1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:45.867925 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:45.890463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:45.931141 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2387347f0fad448c91b488e057e5bdd1', 'request_id': 'req-27aa4252-561a-4569-81cc-c7e48c265ae1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.940140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2387347f0fad448c91b488e057e5bdd1', 'request_id': 'req-27aa4252-561a-4569-81cc-c7e48c265ae1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.948522 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2387347f0fad448c91b488e057e5bdd1', 'request_id': 'req-27aa4252-561a-4569-81cc-c7e48c265ae1'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.964288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] The token cache is being invalidate because project 2387347f0fad448c91b488e057e5bdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:45.964521 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.965150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:45.966627 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1386/2806] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:45 2022] DELETE /identity/v3/projects/2387347f0fad448c91b488e057e5bdd1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:45.970712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:45.973901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:45.987217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702903a-1715-43a9-bd71-3644cdb7079a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:46.063165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:46.063825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.064113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.064425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] PATH_INFO: `/v3/users/38eb5b706a264be5ae9f47c2386fef53` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.065691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eb5b706a264be5ae9f47c2386fef53)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:46.067715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:46.128047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eb5b706a264be5ae9f47c2386fef53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.136753 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eb5b706a264be5ae9f47c2386fef53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.144792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eb5b706a264be5ae9f47c2386fef53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.145850 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eb5b706a264be5ae9f47c2386fef53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.160773 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-ea6d6188-a36b-447b-a8f5-fe292b99063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eb5b706a264be5ae9f47c2386fef53'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.172799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1421/2807] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:45 2022] DELETE /identity/v3/users/38eb5b706a264be5ae9f47c2386fef53 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:46.409165 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:46.410872 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:46.450814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4252-561a-4569-81cc-c7e48c265ae1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:46.523938 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:46.524588 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.524981 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.525355 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] PATH_INFO: `/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.526641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e16d823a1fd4f3f88ce9cd863bf2e1b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:46.531353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:46.584884 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e16d823a1fd4f3f88ce9cd863bf2e1b', 'request_id': 'req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.595594 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e16d823a1fd4f3f88ce9cd863bf2e1b', 'request_id': 'req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.602373 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e16d823a1fd4f3f88ce9cd863bf2e1b', 'request_id': 'req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.617465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] The token cache is being invalidate because project 2e16d823a1fd4f3f88ce9cd863bf2e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:46.617751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.618545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-eb336c08-f46b-4d60-90c1-a2366f0dcd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:46.620518 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1387/2808] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:46 2022] DELETE /identity/v3/projects/2e16d823a1fd4f3f88ce9cd863bf2e1b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:46.625298 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.625799 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.625923 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.648125 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:46.649518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:46.668931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:46.721322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1422/2809] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:46.730723 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.731129 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.731310 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.752793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:46.754033 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:46.765479 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1388/2810] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:46.767523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:46.778434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ef166-8d89-446a-a8cd-1e07d5cd1dcb None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:46.783303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:46.783948 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.784214 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.784488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.785158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:46.785468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:46.787170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:46.804680 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1423/2811] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:46.806297 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:46.818411 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857019-cd6b-48e0-8751-e38f3a89069d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:46.824328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:46.824935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.825216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.825487 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.826118 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:46.828064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:46.883486 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1389/2812] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:46 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:46.884746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:46.895720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e396b46-9ba4-444c-8495-faecbdc49476 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:46.965590 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:46.966210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:46.966492 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:46.966764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:46.967553 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:46.969480 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:46.998845 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1424/2813] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:46 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:47.000084 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.010039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:47.014942 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214f7f3-ae82-4017-b26a-1e8253b90e0b admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.024126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.024950 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.025368 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.025717 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.026493 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.028655 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.042509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1390/2814] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:47.046725 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.058033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743c3a6-8581-433f-a751-81824ab78e13 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.063095 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.063734 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.064016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.064289 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.064950 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.066812 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bb15c-b88f-4f6f-b937-dead55b33869 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.082100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1425/2815] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:47.084068 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.095762 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f9d5f-4c62-44ef-ad63-971123d537b7 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.100657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.102058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.102369 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.102693 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] PATH_INFO: `/v3/projects/212e7999202148208d16739e2f84ef73/users/50f9a05d1bf14431a79baa41ddae8939/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.123816 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=212e7999202148208d16739e2f84ef73, user_id=50f9a05d1bf14431a79baa41ddae8939, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.126570 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.141835 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1391/2816] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:47 2022] PUT /identity/v3/projects/212e7999202148208d16739e2f84ef73/users/50f9a05d1bf14431a79baa41ddae8939/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:47.153644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750894-181f-4027-b906-f30a9006c88e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.153931 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750894-181f-4027-b906-f30a9006c88e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.154207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750894-181f-4027-b906-f30a9006c88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.204787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-98750894-181f-4027-b906-f30a9006c88e None None] MFA Rules not processed for user `50f9a05d1bf14431a79baa41ddae8939`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:47.204787 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98750894-181f-4027-b906-f30a9006c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:47.279827 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1426/2817] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:47.280998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.357506 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9052749-4d1b-45dc-b96e-e28f1380cdfb admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.362346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.362966 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.363285 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.363563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.364202 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.366126 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.399559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1392/2818] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:47.403375 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98750894-181f-4027-b906-f30a9006c88e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.414796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98750894-181f-4027-b906-f30a9006c88e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.430223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:47.487427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.488021 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.488303 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.488585 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.489232 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.491387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.516443 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1427/2819] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:47 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:47.520514 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.532566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b727b-bc52-470b-baf1-c58ecfe928c4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.538448 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.539268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.539549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.539827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.541020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.542746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.565415 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.565864 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1393/2820] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:47.576831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355728f-0518-41d9-8bfb-01579186c568 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.583346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.584016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.584304 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.584584 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] PATH_INFO: `/v3/projects/81d4645359e548159a174449a2346f23/users/35cd9ac3c7fa43cebc299f3f833084e6/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.602838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d4645359e548159a174449a2346f23, user_id=35cd9ac3c7fa43cebc299f3f833084e6, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.605592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.622608 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1428/2821] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:47 2022] PUT /identity/v3/projects/81d4645359e548159a174449a2346f23/users/35cd9ac3c7fa43cebc299f3f833084e6/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:47.626595 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.637689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c681-f535-432c-9f4e-4b9d52bf71b7 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.707288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.708232 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.708656 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.709191 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.709930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.711647 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4210e-198e-45de-8331-3a3ec94828ba admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.722898 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1394/2822] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:47.727048 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.739502 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d848864-6f36-42de-88eb-dd720789ea51 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.744866 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.745786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.746065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.746339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] PATH_INFO: `/v3/projects/81d4645359e548159a174449a2346f23/users/35cd9ac3c7fa43cebc299f3f833084e6/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.748328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d4645359e548159a174449a2346f23, user_id=35cd9ac3c7fa43cebc299f3f833084e6, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:47.751028 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:47.764269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1429/2823] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:47 2022] PUT /identity/v3/projects/81d4645359e548159a174449a2346f23/users/35cd9ac3c7fa43cebc299f3f833084e6/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:47.775189 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.775474 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.775774 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:47.809415 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] MFA Rules not processed for user `35cd9ac3c7fa43cebc299f3f833084e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:47.810868 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:47.848382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:47.899920 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1395/2824] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:47.910833 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:47.912709 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:47.991596 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681cdc-fb2b-4987-a47c-09b4adcf101d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:47.996274 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:47.996989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:47.997328 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:47.997666 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:48.008732 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:48.010236 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:48.021759 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1430/2825] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:48.143293 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:48.154050 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7d99-f029-41db-acc2-6b812b8fc1c3 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:48.159073 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:48.159825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:48.160156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:48.160543 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:48.236935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:48.238700 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e6517-e38a-43c7-abd7-6e1ca324154c service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:48.249166 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1396/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:50.972690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:51.036206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b7d7-8f04-4d39-b8c7-44ec279b5123 service cinder] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:51.041687 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:51.042253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.042534 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.042813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] PATH_INFO: `/v3/users/50f9a05d1bf14431a79baa41ddae8939` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.044030 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f9a05d1bf14431a79baa41ddae8939)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:51.045964 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:51.060179 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:51.092136 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f9a05d1bf14431a79baa41ddae8939'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.098717 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f9a05d1bf14431a79baa41ddae8939'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.107684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f9a05d1bf14431a79baa41ddae8939'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.108294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f9a05d1bf14431a79baa41ddae8939'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.121387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f9a05d1bf14431a79baa41ddae8939'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.127099 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1431/2827] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:50 2022] DELETE /identity/v3/users/50f9a05d1bf14431a79baa41ddae8939 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:51.131549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.132109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.132109 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.150622 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:51.151863 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.208961 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1397/2828] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:51.218786 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:51.220537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.279938 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cd0d-ac9d-4232-9d76-82d2170a8b42 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:51.283660 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:51.284259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.284542 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.284817 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.293769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:51.295171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481214e-a7c1-4cf2-bb93-50e0b01363d1 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:51.304791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1432/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:51.575347 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:51.576755 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.589186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d86bb-3af7-4741-9330-8bd54285eee7 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:51.595356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:51.596422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.596907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.597413 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] PATH_INFO: `/v3/projects/212e7999202148208d16739e2f84ef73` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.599431 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212e7999202148208d16739e2f84ef73)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:51.605564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:51.655392 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212e7999202148208d16739e2f84ef73', 'request_id': 'req-b495012d-0099-4550-82e5-8c64768cf142'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.664022 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212e7999202148208d16739e2f84ef73', 'request_id': 'req-b495012d-0099-4550-82e5-8c64768cf142'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.666332 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:51.671350 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212e7999202148208d16739e2f84ef73', 'request_id': 'req-b495012d-0099-4550-82e5-8c64768cf142'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.678456 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.678751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.679100 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.683930 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] The token cache is being invalidate because project 212e7999202148208d16739e2f84ef73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:51.684241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.685007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.686692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1398/2830] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:51 2022] DELETE /identity/v3/projects/212e7999202148208d16739e2f84ef73 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:51.690426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:51.692032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.700738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] MFA Rules not processed for user `ea26d0ce8e3540289d31c4981db0596a`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:51.701919 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.758518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1433/2831] 10.222.0.30 () {58 vars in 967 bytes} [Tue Aug 30 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:51.758827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495012d-0099-4550-82e5-8c64768cf142 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:51.763827 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:51.764462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.764744 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.765021 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] PATH_INFO: `/v3/users/35cd9ac3c7fa43cebc299f3f833084e6` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.766186 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cd9ac3c7fa43cebc299f3f833084e6)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:51.768128 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:51.770653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:51.772042 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.823167 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:51.823832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cd9ac3c7fa43cebc299f3f833084e6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.842394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cd9ac3c7fa43cebc299f3f833084e6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.849829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cd9ac3c7fa43cebc299f3f833084e6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.852956 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7049-7c01-417b-a57f-f994501a3584 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:51.858350 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72c7ab7c53954787bbd3970c139ceb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:51.858671 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cd9ac3c7fa43cebc299f3f833084e6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.859168 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:51.859325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cd9ac3c7fa43cebc299f3f833084e6'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:51.859512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:51.859794 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:51.861653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:51.865782 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1399/2832] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:51 2022] DELETE /identity/v3/users/35cd9ac3c7fa43cebc299f3f833084e6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:51.873116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:51.874712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea99c-66c5-4664-8906-18d358db0c02 service swift] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:51.883970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1434/2833] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Aug 30 16:23:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 16:23:52.160830 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.163161 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:52.248080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe6c1-4a9c-4789-bc35-34b3a2157207 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.252819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.253462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.253733 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.254015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] PATH_INFO: `/v3/projects/81d4645359e548159a174449a2346f23` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.255280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d4645359e548159a174449a2346f23)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.257807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.266340 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:52.309292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d4645359e548159a174449a2346f23', 'request_id': 'req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:52.316562 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d4645359e548159a174449a2346f23', 'request_id': 'req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:52.322858 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d4645359e548159a174449a2346f23', 'request_id': 'req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:52.334361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] The token cache is being invalidate because project 81d4645359e548159a174449a2346f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:52.334592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:52.335407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-a2e37bf5-4c7d-4579-b2fe-838e28fcfc81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:52.336913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1400/2834] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:52 2022] DELETE /identity/v3/projects/81d4645359e548159a174449a2346f23 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:52.341911 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.342381 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.342478 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.364682 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:52.365930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:52.429428 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1435/2835] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:52.437294 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.437652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.437996 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.458230 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:52.459485 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:52.468052 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1401/2836] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:52.472225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.482600 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b4fe-2fc4-4b8f-a7d5-2f9dc1570ebb None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.487240 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.487830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.488113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.488388 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.489032 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:52.489335 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.490930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.502559 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1436/2837] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:52.506784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.516069 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336fe35-2c63-4424-ab10-f1919edf4626 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.520699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.521288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.521581 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.521833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.522447 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.524894 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.552825 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1402/2838] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:52 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:52.556996 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.566834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a8281-8487-4195-8020-eb4154bc3aee admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.623385 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.623901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.624181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.624453 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.625071 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.627008 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.648761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1437/2839] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:52 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:52.653064 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.662955 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ef7-8344-44f9-9c78-1a20f55d8317 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.667603 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.668187 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.668463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.668731 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.669361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.670935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.680665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1403/2840] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:52.684458 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.694403 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f17ab-c5fc-4078-989a-76b15313c1d4 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.699807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.700461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.700740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.701009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.701645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.703257 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c293-0c38-4b5e-9264-acf245e0ed1b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.714308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1438/2841] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:52.718354 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.728274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d348a4e-8e75-406e-94ba-ef12d3c93cae admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.732831 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.733465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.733743 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.734017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] PATH_INFO: `/v3/projects/ff25c9b0b58a4896b2bacca346f022a1/users/136d5929f01c4028a02cd6476f70a452/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.748641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff25c9b0b58a4896b2bacca346f022a1, user_id=136d5929f01c4028a02cd6476f70a452, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.751280 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.764732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1404/2842] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:52 2022] PUT /identity/v3/projects/ff25c9b0b58a4896b2bacca346f022a1/users/136d5929f01c4028a02cd6476f70a452/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:52.776507 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.776792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.777065 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.804182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] MFA Rules not processed for user `136d5929f01c4028a02cd6476f70a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:52.805405 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:52.829710 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:52.874142 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1439/2843] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:23:52.885586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:52.887328 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:52.945356 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224682b-e2f7-4497-8596-89e474aaccbb admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:52.949013 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:52.949607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:52.949886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:52.950158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:52.958213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:52.959751 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:52.969412 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1405/2844] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:53.833345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:53.834901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:53.905011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9be8a-cf5f-4cb0-9f71-d3dea301c5b2 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:53.909729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:53.910349 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:53.910632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:53.910908 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] PATH_INFO: `/v3/users/b41ae60ee987459cb0d37ec80e85efa3` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:53.912056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41ae60ee987459cb0d37ec80e85efa3)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:53.914694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:53.959886 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41ae60ee987459cb0d37ec80e85efa3'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:53.967320 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41ae60ee987459cb0d37ec80e85efa3'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:53.974701 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41ae60ee987459cb0d37ec80e85efa3'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:53.975347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41ae60ee987459cb0d37ec80e85efa3'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:53.987718 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2cc7fe8c-1aac-49da-9bfe-8fb95b118c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41ae60ee987459cb0d37ec80e85efa3'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:53.993545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1440/2845] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:53 2022] DELETE /identity/v3/users/b41ae60ee987459cb0d37ec80e85efa3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:54.163742 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.174726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab99cb-9a32-46dd-8daf-682dcc636afb service cinder] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.207011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:54.234007 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.234582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.234859 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.235156 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] PATH_INFO: `/v3/projects/71d13926aede402197a210920713b405` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.236257 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d13926aede402197a210920713b405)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.238153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.287101 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d13926aede402197a210920713b405', 'request_id': 'req-b48bba38-1dc4-44b2-b774-edf65b4f99b2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:54.295528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d13926aede402197a210920713b405', 'request_id': 'req-b48bba38-1dc4-44b2-b774-edf65b4f99b2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:54.304159 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d13926aede402197a210920713b405', 'request_id': 'req-b48bba38-1dc4-44b2-b774-edf65b4f99b2'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:54.316784 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] The token cache is being invalidate because project 71d13926aede402197a210920713b405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:54.316922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:54.317602 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b48bba38-1dc4-44b2-b774-edf65b4f99b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:54.319146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1406/2846] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:54 2022] DELETE /identity/v3/projects/71d13926aede402197a210920713b405 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:54.324699 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.324992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.325266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.345473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:54.346688 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:54.393691 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:54.416872 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1441/2847] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:54.424610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.424958 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.425234 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.446989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:54.448248 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:54.456352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1407/2848] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:54.461410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.472852 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd247-8d76-402b-bd00-efed2853410b None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.479036 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.479645 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.480009 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.480291 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.480992 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:54.481439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.483075 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.500199 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1442/2849] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:54.501407 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.512311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778f9e-6cad-4a08-a3d3-edf22c6bcf5a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.517044 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.517632 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.517908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.518175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.518895 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.521009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.548215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1408/2850] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:54 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:54.552452 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.563276 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85a594-db18-415d-8aa8-a445d010fd49 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.623382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.623993 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.624278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.624555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.625193 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.627153 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.648669 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1443/2851] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:54 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:54.652806 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.662999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f940-21f0-4807-b332-e10977be47c0 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.667757 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.668352 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.668634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.668907 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.669549 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.671177 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.681507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1409/2852] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:54.685384 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.695821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289209f-0d1f-4972-99e6-0db82951ddc3 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.700424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.701011 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.701292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.701567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.702206 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.703825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346b2ed-db42-4e83-bed5-7bc8d15dd019 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.714448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1444/2853] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:54.718491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.728545 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6f5-0e1f-4a06-89ad-0eb4eea60dc6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.733303 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.733997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.734283 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.734564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] PATH_INFO: `/v3/projects/233639bbf4cb4c1f8983f1cc04b49fc3/users/833e194424174dc7ba368bacf9247e5e/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.749865 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=233639bbf4cb4c1f8983f1cc04b49fc3, user_id=833e194424174dc7ba368bacf9247e5e, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.752498 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.765829 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1410/2854] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:54 2022] PUT /identity/v3/projects/233639bbf4cb4c1f8983f1cc04b49fc3/users/833e194424174dc7ba368bacf9247e5e/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:23:54.775949 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.776234 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.776509 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.803613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] MFA Rules not processed for user `833e194424174dc7ba368bacf9247e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:54.805352 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:54.868369 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1445/2855] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:54.880476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:54.882432 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:54.939038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3020e-eaaa-459e-a45a-914ff05d91ae admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:54.942651 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:54.943273 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:54.943552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:54.943820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:54.952346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:54.953761 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fc941-6964-400b-bb7a-72045f279117 service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:54.962688 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1411/2856] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:54.987476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.030200 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:55.051499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aabfc-0f3d-4123-8dec-e407bc86a182 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:55.056698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:55.057323 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.057603 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.057876 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] PATH_INFO: `/v3/users/833e194424174dc7ba368bacf9247e5e` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.059033 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] RBAC: Authorizing `identity:delete_user(user_id=833e194424174dc7ba368bacf9247e5e)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:55.060954 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:55.106307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833e194424174dc7ba368bacf9247e5e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.113582 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833e194424174dc7ba368bacf9247e5e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.121347 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833e194424174dc7ba368bacf9247e5e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.121982 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833e194424174dc7ba368bacf9247e5e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.133885 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833e194424174dc7ba368bacf9247e5e'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.139751 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1446/2857] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:54 2022] DELETE /identity/v3/users/833e194424174dc7ba368bacf9247e5e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:55.144198 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.144580 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.145284 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.155427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:55.167854 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:55.169121 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:55.227404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1412/2858] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:55.237170 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.238567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:55.295068 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065540-d6d3-4455-b744-21a8aa6a144a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:55.298670 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:55.299292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.299574 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.299853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.309235 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:55.310844 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a22d8e-57da-4ae6-9e35-7dc5f1879d6a service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:55.320220 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1447/2859] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:23:55.597213 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.598686 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:55.611483 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c91133-000f-44e9-972f-7e265d6910fa None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:55.616699 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:55.617335 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.619228 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.619565 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] PATH_INFO: `/v3/projects/233639bbf4cb4c1f8983f1cc04b49fc3` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.621072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=233639bbf4cb4c1f8983f1cc04b49fc3)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:55.623170 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:55.674008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233639bbf4cb4c1f8983f1cc04b49fc3', 'request_id': 'req-57c1956b-df7f-4992-81fe-0546d6bdc92e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.681999 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233639bbf4cb4c1f8983f1cc04b49fc3', 'request_id': 'req-57c1956b-df7f-4992-81fe-0546d6bdc92e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.688532 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233639bbf4cb4c1f8983f1cc04b49fc3', 'request_id': 'req-57c1956b-df7f-4992-81fe-0546d6bdc92e'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.702045 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] The token cache is being invalidate because project 233639bbf4cb4c1f8983f1cc04b49fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:55.702339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.703006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-57c1956b-df7f-4992-81fe-0546d6bdc92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:55.704541 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1413/2860] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:55 2022] DELETE /identity/v3/projects/233639bbf4cb4c1f8983f1cc04b49fc3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:55.709342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.709702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.710634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.732192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:55.733516 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:55.796259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1448/2861] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:55.806092 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.806461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.806832 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.829578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:55.830793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:55.841434 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1414/2862] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:55.845856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.853183 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:55.859062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806943be-122d-407b-8351-f61e6eb2bea9 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:55.865476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:55.867078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.867392 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.868003 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.868694 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:55.869322 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:55.871720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:55.884165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1449/2863] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 16:23:55.888608 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.900329 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af7a7-a7a1-4635-ba6e-070d9cb7251e None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:55.905123 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:55.907080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:55.907080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:55.907080 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:55.907459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:55.909011 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:55.939057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1415/2864] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:55 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:23:55.942242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:55.952508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c4c41-001f-42c2-abcb-e967785da21a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:56.019952 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:56.020571 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.020857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.021135 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.021855 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:56.024464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:56.050724 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1450/2865] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:55 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:56.052215 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:56.062513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccaccc-c647-43a1-96f6-894beb2bca69 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:56.067136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:56.067726 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.068000 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.068268 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.068897 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:56.070664 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:56.081072 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1416/2866] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:56.085916 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:56.098177 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adc482-a40c-4c37-ad80-d1e848f7d47e admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:56.103863 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:56.104464 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.104761 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.105038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.105683 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:56.107308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91a54f-94d6-4779-8646-2a32aa7d7a40 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:56.119561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1451/2867] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:56.124116 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:56.133927 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9af4-d880-4682-920a-5cf122f39575 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:56.138640 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:56.139320 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.139600 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.139879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] PATH_INFO: `/v3/projects/b296b4da822d4db79d17125a3c89a39b/users/0aa6378cd44349b39d9321e11a130ca4/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.161175 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b296b4da822d4db79d17125a3c89a39b, user_id=0aa6378cd44349b39d9321e11a130ca4, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:56.164720 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:56.178220 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1417/2868] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:56 2022] PUT /identity/v3/projects/b296b4da822d4db79d17125a3c89a39b/users/0aa6378cd44349b39d9321e11a130ca4/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:56.243287 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.243572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.243851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.271873 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] MFA Rules not processed for user `0aa6378cd44349b39d9321e11a130ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:56.273146 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:56.340389 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1452/2869] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:56.352255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:56.354501 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:56.384290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:56.417462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5948-b039-4fbb-b553-bd79eaef127e admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:56.421176 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:56.421773 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:56.422054 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:56.422325 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:56.431057 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:56.432475 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028914a-125e-4c08-9533-53b3b01b6e0e service cinder] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:56.441164 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1418/2870] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:23:58.342607 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:58.344115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:58.413482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:58.420231 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d837a6c-5604-4dc9-a00d-99f24b26d7e6 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:58.425723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:58.426466 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:58.426632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:58.426900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] PATH_INFO: `/v3/users/136d5929f01c4028a02cd6476f70a452` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:58.428053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136d5929f01c4028a02cd6476f70a452)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:58.430692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:58.487207 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136d5929f01c4028a02cd6476f70a452'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:58.498277 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136d5929f01c4028a02cd6476f70a452'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:58.506731 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136d5929f01c4028a02cd6476f70a452'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:58.507379 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136d5929f01c4028a02cd6476f70a452'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:58.521103 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136d5929f01c4028a02cd6476f70a452'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:58.528856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1453/2871] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:23:58 2022] DELETE /identity/v3/users/136d5929f01c4028a02cd6476f70a452 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:58.533458 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:58.533964 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:58.534077 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:58.554496 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:58.556398 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:58.622819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1419/2872] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:58.633152 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:58.634797 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:58.696803 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ea39-212f-4e18-8db7-fa793201b6b8 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:58.700477 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:58.701080 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:58.701358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:58.701629 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:58.713715 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:58.717046 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647d0c6-95b8-477d-93cc-eeb73cff4585 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:58.727412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1454/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:23:59.036015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.037422 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:59.050497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba33e-08b0-4789-8657-c11f0f582c5c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.056684 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.056972 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.057154 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.057427 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] PATH_INFO: `/v3/projects/ff25c9b0b58a4896b2bacca346f022a1` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.058569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff25c9b0b58a4896b2bacca346f022a1)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.060519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.111026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff25c9b0b58a4896b2bacca346f022a1', 'request_id': 'req-f7dae9c1-41ce-491f-846b-68d97e16ab56'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:59.119346 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff25c9b0b58a4896b2bacca346f022a1', 'request_id': 'req-f7dae9c1-41ce-491f-846b-68d97e16ab56'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:59.129689 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff25c9b0b58a4896b2bacca346f022a1', 'request_id': 'req-f7dae9c1-41ce-491f-846b-68d97e16ab56'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:59.145470 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] The token cache is being invalidate because project ff25c9b0b58a4896b2bacca346f022a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:23:59.145776 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:59.146482 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-f7dae9c1-41ce-491f-846b-68d97e16ab56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:23:59.149814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1420/2874] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:59 2022] DELETE /identity/v3/projects/ff25c9b0b58a4896b2bacca346f022a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:59.159242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.159242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.159242 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.176807 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:59.178344 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:59.238840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1455/2875] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:59.247158 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.247459 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.247746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.269476 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:59.270882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:59.279839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1421/2876] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:59.284284 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.294966 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d052-e6ef-4fe8-afee-e4744eb9df64 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.300339 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.301062 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.301395 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.301700 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] PATH_INFO: `/v3/domains` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.302461 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:23:59.302823 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.304515 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.316354 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1456/2877] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:23:59.321604 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.331114 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4735192-1433-4a62-ba49-8c77a82745a8 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.336610 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.337206 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.337592 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.337873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.338519 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.340465 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.372247 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1422/2878] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:59.376308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.387018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c92a-cd6a-477f-990a-3bea1b220011 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.390560 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:59.444308 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.445410 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.445750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.446026 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.446665 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.448620 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.469634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1457/2879] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:59.473815 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.484462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd3a4-ddca-4fee-a4c1-cb3ab5f3ec5a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.489019 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.489607 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.489881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.490150 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.490824 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.492922 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.503255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1423/2880] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:59.507061 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.517631 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5eb4d-0946-46cb-bb00-5b32703b04ba admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.522433 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.523165 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.523971 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.524244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.524999 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.526612 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952a1d-e294-42f7-a959-6a839e5d1350 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.537500 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1458/2881] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:59.541788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.551711 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cb9c3-44ad-41b9-92c1-066bb6edeaf9 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.556886 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.557527 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.557808 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.558083 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] PATH_INFO: `/v3/projects/9d814ef6fea4437f8af7dcfbd8d2e817/users/1d11b4918508426890b22f9864600d6b/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.566216 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:59.574488 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d814ef6fea4437f8af7dcfbd8d2e817, user_id=1d11b4918508426890b22f9864600d6b, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.577471 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.591357 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1424/2882] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:59 2022] PUT /identity/v3/projects/9d814ef6fea4437f8af7dcfbd8d2e817/users/1d11b4918508426890b22f9864600d6b/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:59.602704 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.603016 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.603296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.631279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] MFA Rules not processed for user `1d11b4918508426890b22f9864600d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:23:59.632970 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:23:59.697007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1459/2883] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:23:59.701564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.762944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe7a1-30ad-403a-8302-77521fbebae3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.767654 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.768255 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.768540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.768820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.769461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.771420 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.796879 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1425/2884] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:59.801051 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.812161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7433-0799-4b7b-a203-9b2c5a28525e None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.869081 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.869695 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.870225 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.870511 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] PATH_INFO: `/v3/users` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.871181 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.873117 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.895340 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1460/2885] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:23:59 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:23:59.899691 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.909915 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e68c-b0c9-4fb7-9eb8-1f9e276a68dd admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.914804 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.915446 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.915712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.916026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.916683 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.918271 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.928558 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1426/2886] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:23:59.933674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.939933 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:59.944161 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fad57-51eb-4023-85b1-f7b2ab37a12a admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:23:59.950750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:23:59.951427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:23:59.951712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:23:59.951991 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] PATH_INFO: `/v3/projects/d80871e306fe4479b52db1a160906860/users/8e4ab24045754946a02d6653726c9ef4/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:23:59.966482 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80871e306fe4479b52db1a160906860, user_id=8e4ab24045754946a02d6653726c9ef4, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:23:59.969192 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:23:59.981711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1461/2887] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:23:59 2022] PUT /identity/v3/projects/d80871e306fe4479b52db1a160906860/users/8e4ab24045754946a02d6653726c9ef4/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:23:59.985552 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:23:59.997134 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a5af-e531-46ce-b4e4-eda8fd74870a admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:00.056491 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:00.057102 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:00.057385 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:00.057662 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:00.058305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:00.059935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aefb3-1b2e-48af-9e2f-2bcfc0713373 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:00.073304 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1427/2888] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:00.074382 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:00.084896 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41459381-4754-43bc-8a73-1adc87e68f9b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:00.089796 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:00.090472 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:00.090755 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:00.091067 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] PATH_INFO: `/v3/projects/d80871e306fe4479b52db1a160906860/users/8e4ab24045754946a02d6653726c9ef4/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:00.093066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80871e306fe4479b52db1a160906860, user_id=8e4ab24045754946a02d6653726c9ef4, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:00.095811 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:00.107940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1462/2889] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:24:00 2022] PUT /identity/v3/projects/d80871e306fe4479b52db1a160906860/users/8e4ab24045754946a02d6653726c9ef4/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:24:00.119151 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:00.119533 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:00.119893 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:00.150017 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] MFA Rules not processed for user `8e4ab24045754946a02d6653726c9ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:00.151208 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:00.211509 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:00.245361 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1428/2890] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 16:24:00.257116 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:00.260279 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:00.330879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53d585-d2ad-4c50-b348-ab0d6488ad4b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:00.334634 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:00.335282 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:00.335793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:00.336429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:00.407674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:00.409134 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c822-af54-4ab5-befb-1ac492ceab7d service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:00.418930 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1463/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:24:02.962339 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:03.025764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88dd9c-3470-45a5-bd12-d6c38bc6e7bb None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:03.030384 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:03.031024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:03.031312 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:03.031590 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] PATH_INFO: `/v3/users/1d11b4918508426890b22f9864600d6b` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:03.032715 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d11b4918508426890b22f9864600d6b)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:03.034639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:03.080153 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d11b4918508426890b22f9864600d6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.092311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d11b4918508426890b22f9864600d6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.099001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d11b4918508426890b22f9864600d6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.106601 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d11b4918508426890b22f9864600d6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.107245 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d11b4918508426890b22f9864600d6b'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.113091 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1429/2892] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:24:02 2022] DELETE /identity/v3/users/1d11b4918508426890b22f9864600d6b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:03.118476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b32926-5785-4374-905f-92cce7f037bf None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:03.118942 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b32926-5785-4374-905f-92cce7f037bf None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:03.119066 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b32926-5785-4374-905f-92cce7f037bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:03.138223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-39b32926-5785-4374-905f-92cce7f037bf None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:03.139448 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-39b32926-5785-4374-905f-92cce7f037bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:03.200874 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1464/2893] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:03.210944 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:03.214292 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:03.275923 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef06ce-a8ff-4056-b913-1126686e5c39 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:03.279687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:03.280288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:03.280569 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:03.280839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:03.290537 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:03.292058 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:03.301692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1430/2894] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:03.565093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b32926-5785-4374-905f-92cce7f037bf None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:03.566525 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-39b32926-5785-4374-905f-92cce7f037bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:03.579514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b32926-5785-4374-905f-92cce7f037bf None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:03.584476 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:03.585138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:03.585424 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:03.585746 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] PATH_INFO: `/v3/projects/9d814ef6fea4437f8af7dcfbd8d2e817` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:03.587429 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d814ef6fea4437f8af7dcfbd8d2e817)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:03.589299 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:03.608894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:03.639272 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d814ef6fea4437f8af7dcfbd8d2e817', 'request_id': 'req-3193807b-5449-4cc2-9501-29920ad3bd76'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.646536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d814ef6fea4437f8af7dcfbd8d2e817', 'request_id': 'req-3193807b-5449-4cc2-9501-29920ad3bd76'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.653266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d814ef6fea4437f8af7dcfbd8d2e817', 'request_id': 'req-3193807b-5449-4cc2-9501-29920ad3bd76'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.663801 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] The token cache is being invalidate because project 9d814ef6fea4437f8af7dcfbd8d2e817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:24:03.664096 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.665348 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.666860 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1465/2895] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:24:03 2022] DELETE /identity/v3/projects/9d814ef6fea4437f8af7dcfbd8d2e817 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:03.671024 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:03.676989 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:03.680638 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f47-a4d3-4917-91f5-0a18a6fa9b02 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:03.743945 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:03.744609 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:03.744891 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:03.745564 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] PATH_INFO: `/v3/users/8e4ab24045754946a02d6653726c9ef4` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:03.746690 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4ab24045754946a02d6653726c9ef4)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:03.748652 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:03.795520 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4ab24045754946a02d6653726c9ef4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.807252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4ab24045754946a02d6653726c9ef4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.814048 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4ab24045754946a02d6653726c9ef4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.821136 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4ab24045754946a02d6653726c9ef4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.821962 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-28b6cd98-4f1a-474c-b91d-6dc2b03d4b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4ab24045754946a02d6653726c9ef4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:03.827926 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1431/2896] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:24:03 2022] DELETE /identity/v3/users/8e4ab24045754946a02d6653726c9ef4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:04.107324 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.108792 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:04.124561 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193807b-5449-4cc2-9501-29920ad3bd76 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.183045 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.183619 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.183902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.184175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] PATH_INFO: `/v3/projects/d80871e306fe4479b52db1a160906860` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.185296 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80871e306fe4479b52db1a160906860)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.187259 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.232523 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80871e306fe4479b52db1a160906860', 'request_id': 'req-db8c846e-22d7-4122-9752-48cbc88e0dcb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:04.239425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80871e306fe4479b52db1a160906860', 'request_id': 'req-db8c846e-22d7-4122-9752-48cbc88e0dcb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:04.247052 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80871e306fe4479b52db1a160906860', 'request_id': 'req-db8c846e-22d7-4122-9752-48cbc88e0dcb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:04.259387 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] The token cache is being invalidate because project d80871e306fe4479b52db1a160906860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:24:04.259677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:04.260326 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-db8c846e-22d7-4122-9752-48cbc88e0dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:04.262024 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1466/2897] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:24:04 2022] DELETE /identity/v3/projects/d80871e306fe4479b52db1a160906860 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:04.267249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.267249 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.267734 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.287882 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:04.289143 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:04.353174 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1432/2898] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:04.361258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.361578 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.361857 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.381720 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:04.382910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:04.390894 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1467/2899] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:04.395403 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.405466 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b71c-ac0f-4457-b246-c8d1a8d6a28d None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.410035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.410634 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.410910 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.411233 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.411877 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:24:04.412201 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.413779 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.425635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1433/2900] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:24:04.430309 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.440049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9917-3b7d-4d5b-84e5-fe29239a70e5 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.446917 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.447544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.447834 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.448114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.448902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.450879 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.480412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1468/2901] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:24:04 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:24:04.484706 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.494561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a23fe4-b9d2-4826-a8ed-9c6c7dcc13a4 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.502614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:04.553659 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.554252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.554529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.554799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.555484 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.557371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.578146 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1434/2902] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:24:04 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:24:04.582283 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.593091 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbd9d-6693-4dcd-87a6-d9ab24d41b0b admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.597738 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.598329 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.598615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.598890 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.599563 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.601171 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.602506 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:04.613449 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1469/2903] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:04.616850 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.627295 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575244-27e6-4d86-8c19-d8326072fc20 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.631946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.632561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.632843 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.633625 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.634274 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.635902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85aafe-4cf7-44ac-8dd5-5a1f6fb631d9 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.646252 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1435/2904] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:04.651244 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.661342 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6810-94b3-44e0-a838-f026b6c3b50e admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.666097 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.666743 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.667056 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.667333 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] PATH_INFO: `/v3/projects/c0886b15046246fab3d1b5ce780fef03/users/2b3dc803ec9742528d8cee9579d3cbef/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.682018 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0886b15046246fab3d1b5ce780fef03, user_id=2b3dc803ec9742528d8cee9579d3cbef, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.684769 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.698440 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1470/2905] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:24:04 2022] PUT /identity/v3/projects/c0886b15046246fab3d1b5ce780fef03/users/2b3dc803ec9742528d8cee9579d3cbef/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:04.769692 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.769974 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.770251 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.799405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] MFA Rules not processed for user `2b3dc803ec9742528d8cee9579d3cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:04.800614 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:04.863814 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1436/2906] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:04.875285 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:04.877093 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:04.933468 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c487-4132-4de7-80ba-1d12f78496ef admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:04.937113 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6e7b66794e4416ba15562e47e9888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:04.937707 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:04.937989 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:04.938264 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:04.946914 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:04.948368 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a77a43-da4a-458c-9eb1-6923c9281008 service cinder] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:04.957060 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1471/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:06.498023 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:06.499525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:06.572852 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1e019-5cac-4743-a0b5-bc5d6228739a None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:06.577461 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:06.578099 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:06.578382 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:06.578660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] PATH_INFO: `/v3/users/0aa6378cd44349b39d9321e11a130ca4` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:06.579820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa6378cd44349b39d9321e11a130ca4)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:06.582020 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:06.605001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:06.648256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa6378cd44349b39d9321e11a130ca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:06.661836 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa6378cd44349b39d9321e11a130ca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:06.670008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa6378cd44349b39d9321e11a130ca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:06.682838 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa6378cd44349b39d9321e11a130ca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:06.683918 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa6378cd44349b39d9321e11a130ca4'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:06.690949 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1437/2908] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:24:06 2022] DELETE /identity/v3/users/0aa6378cd44349b39d9321e11a130ca4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:06.695217 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:06.696278 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:06.696583 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:06.716984 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:06.718572 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:06.783078 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1472/2909] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:06.793100 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:06.794536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:06.854066 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9790829-3fc8-4e54-a876-ee1af5ece2a1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:06.857793 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:06.858405 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:06.858687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:06.858965 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:06.869097 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:06.870799 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1336c-3d5e-41d6-b8a8-5583850cd954 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:06.880433 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1438/2910] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:07.152437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.153978 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:07.166437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63f31c-e25f-4bf4-9f43-b912f301aeae None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.171188 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.171813 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.172853 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.173138 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] PATH_INFO: `/v3/projects/b296b4da822d4db79d17125a3c89a39b` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.174442 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b296b4da822d4db79d17125a3c89a39b)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.176551 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.224544 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b296b4da822d4db79d17125a3c89a39b', 'request_id': 'req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:07.232434 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b296b4da822d4db79d17125a3c89a39b', 'request_id': 'req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:07.238537 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b296b4da822d4db79d17125a3c89a39b', 'request_id': 'req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:07.245390 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:07.250723 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] The token cache is being invalidate because project b296b4da822d4db79d17125a3c89a39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:24:07.251280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:07.252427 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-3b6828d9-33b8-4ef3-99fe-abf1b1841f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:07.254258 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1473/2911] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:24:07 2022] DELETE /identity/v3/projects/b296b4da822d4db79d17125a3c89a39b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:07.259244 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.259528 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.259807 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.279639 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:07.280833 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:07.339539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1439/2912] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:07.347223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633398-4540-41a7-af77-21b146a62169 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.347512 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633398-4540-41a7-af77-21b146a62169 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.347791 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633398-4540-41a7-af77-21b146a62169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.370926 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-f7633398-4540-41a7-af77-21b146a62169 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:07.372155 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f7633398-4540-41a7-af77-21b146a62169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:07.380133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1474/2913] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:07.384457 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.394119 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a90b-2003-4cae-95cb-6f619230329c None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.399426 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.400035 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.400313 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.400586 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.401241 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 16:24:07.401547 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.403181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.419042 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1440/2914] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Aug 30 16:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 16:24:07.421004 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633398-4540-41a7-af77-21b146a62169 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.430932 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633398-4540-41a7-af77-21b146a62169 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.435861 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.436573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.436856 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.437150 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.437793 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.439740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.466598 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1475/2915] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:24:07.471152 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.481695 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac104bd4-c80a-43f7-8597-9b99c181ab94 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.508913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:07.541330 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.541937 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.542221 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.542497 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.543162 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.545093 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.567534 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1441/2916] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:24:07 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 16:24:07.569439 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.579678 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a300d-874e-4cea-a665-363780840b54 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.584182 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.584765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.585041 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.585313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.585946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.587575 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.597261 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1476/2917] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:07.601032 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.611451 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4ff8-0521-4169-818d-ac28eb882cb6 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.616039 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.616624 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.616908 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.617184 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.618525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.620423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43216e-24d0-4ab4-9fae-eb8471d75922 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.630820 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1442/2918] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:07.634909 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.644762 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328984-69b3-4cb7-8640-a490aac3220d admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.649307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.649940 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.650218 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.650490 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] PATH_INFO: `/v3/projects/7ea06918c1784d9284f0b999dff94ec5/users/0977ec7de09f4205a9411d712f4550c8/roles/e635c23c0fae471ea6d0f2de2d71799f` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.665398 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea06918c1784d9284f0b999dff94ec5, user_id=0977ec7de09f4205a9411d712f4550c8, role_id=e635c23c0fae471ea6d0f2de2d71799f)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.668133 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.681007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1477/2919] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:24:07 2022] PUT /identity/v3/projects/7ea06918c1784d9284f0b999dff94ec5/users/0977ec7de09f4205a9411d712f4550c8/roles/e635c23c0fae471ea6d0f2de2d71799f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:07.686001 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abee48-5eac-489f-8775-6a7e05f95047 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.686298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abee48-5eac-489f-8775-6a7e05f95047 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.686566 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abee48-5eac-489f-8775-6a7e05f95047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.707308 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-d6abee48-5eac-489f-8775-6a7e05f95047 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:07.708540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-d6abee48-5eac-489f-8775-6a7e05f95047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:07.775417 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1443/2920] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:07.785114 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:07.786887 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:07.855139 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8798e7d-4a6d-454f-8867-75b262f7de46 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:07.859223 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:07.859830 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:07.860105 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:07.860378 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:07.870674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:07.872227 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:07.881985 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1478/2921] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:12.194256 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.194781 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.194902 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.226095 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] MFA Rules not processed for user `0977ec7de09f4205a9411d712f4550c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:12.228272 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:12.307290 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1444/2922] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:12.312821 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.325319 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8a46-007e-46eb-8d2d-19a1b71f534b service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.330545 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.331815 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.332267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.332706 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.333567 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.335901 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.370729 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1479/2923] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Aug 30 16:24:12 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:24:12.374404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.387270 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4daa0e-7920-4435-a16b-63e6179fc747 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.427873 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:12.458764 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.459513 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.459856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.460540 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] PATH_INFO: `/v3/users` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.461423 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.463536 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.489507 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1445/2924] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Aug 30 16:24:12 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 16:24:12.494280 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.504838 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d64b3-543e-4e4b-a3b4-637e7a0b2f6f admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.510905 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.511671 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.512012 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.512345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.513055 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.514740 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.525946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1480/2925] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 16:24:12.530353 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.540786 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480b2d-3d6e-4f33-aa8b-a7af2d9c5082 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.545472 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.546124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.546404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.546676 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] PATH_INFO: `/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4/users/58b630e378c146b78efd172a4a6a65cf/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.562438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5b1717286043d6bca5eb9a98ac3da4, user_id=58b630e378c146b78efd172a4a6a65cf, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.565311 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.579526 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1446/2926] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:24:12 2022] PUT /identity/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4/users/58b630e378c146b78efd172a4a6a65cf/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:24:12.583419 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.594115 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb54370-0123-431b-a040-49f01595dbd2 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.652997 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.654064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.654064 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.654266 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.654825 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.656487 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.662741 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:12.668692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1481/2927] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 16:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 16:24:12.672998 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:12.684788 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c737c8-6aa1-473b-9c81-2a6d830f2197 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:12.689704 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:12.690309 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:12.690589 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:12.690860 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] PATH_INFO: `/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4/users/58b630e378c146b78efd172a4a6a65cf/roles/7a972f46fd9e4eab9286affd0bccd548` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:12.692851 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5b1717286043d6bca5eb9a98ac3da4, user_id=58b630e378c146b78efd172a4a6a65cf, role_id=7a972f46fd9e4eab9286affd0bccd548)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:12.695899 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df82950-fc77-49cb-8608-febaf40292e6 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:12.706374 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1447/2928] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Aug 30 16:24:12 2022] PUT /identity/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4/users/58b630e378c146b78efd172a4a6a65cf/roles/7a972f46fd9e4eab9286affd0bccd548 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:24:15.553166 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:15.556562 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:15.569910 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786b8e3-39b2-40b0-bc15-7f932f45a0c6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:15.645508 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:15.646514 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:15.647269 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:15.647742 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] PATH_INFO: `/v3/users/2b3dc803ec9742528d8cee9579d3cbef` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:15.651346 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3dc803ec9742528d8cee9579d3cbef)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:15.653358 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:15.721536 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3dc803ec9742528d8cee9579d3cbef'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:15.730749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3dc803ec9742528d8cee9579d3cbef'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:15.756555 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3dc803ec9742528d8cee9579d3cbef'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:15.757404 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3dc803ec9742528d8cee9579d3cbef'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:15.785540 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3dc803ec9742528d8cee9579d3cbef'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:15.798412 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1482/2929] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:24:15 2022] DELETE /identity/v3/users/2b3dc803ec9742528d8cee9579d3cbef => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:15.800110 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] REQUEST_METHOD: `POST` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:15.800561 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:15.800657 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:15.833336 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.auth.core [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] MFA Rules not processed for user `b0c8d533e615444eb88b70808ed8254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:15.836597 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:15.936525 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1448/2930] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:15.943765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:15.945677 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:16.066463 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4c50-45d6-4e09-ba6d-49537f4ffed6 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:16.073307 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:16.074271 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:16.074750 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:16.075267 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:16.087216 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:16.090345 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801fdb0-aaaf-4abd-a36e-e0135df89c28 service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:16.104047 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1483/2931] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:16.660765 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:16.662360 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:16.687181 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54299-cee0-42ad-ab1c-fc1746cf1549 None None] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:16.692754 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:16.693462 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:16.697400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:16.697746 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] PATH_INFO: `/v3/projects/c0886b15046246fab3d1b5ce780fef03` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:16.699510 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0886b15046246fab3d1b5ce780fef03)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:16.701997 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:16.831060 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0886b15046246fab3d1b5ce780fef03', 'request_id': 'req-ebb10d55-3ca2-4bd7-b362-7b6086145015'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:16.845641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0886b15046246fab3d1b5ce780fef03', 'request_id': 'req-ebb10d55-3ca2-4bd7-b362-7b6086145015'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:16.870635 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0886b15046246fab3d1b5ce780fef03', 'request_id': 'req-ebb10d55-3ca2-4bd7-b362-7b6086145015'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:16.889641 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] The token cache is being invalidate because project c0886b15046246fab3d1b5ce780fef03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:24:16.889935 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:16.890856 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:24:16.893404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1449/2932] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:24:16 2022] DELETE /identity/v3/projects/c0886b15046246fab3d1b5ce780fef03 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:24:17.573702 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5d8b-ec6f-45f2-81e0-43aa7a9074f2 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:17.574088 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5d8b-ec6f-45f2-81e0-43aa7a9074f2 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:17.574294 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5d8b-ec6f-45f2-81e0-43aa7a9074f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:17.610400 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-4fea5d8b-ec6f-45f2-81e0-43aa7a9074f2 None None] MFA Rules not processed for user `58b630e378c146b78efd172a4a6a65cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:17.611684 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-4fea5d8b-ec6f-45f2-81e0-43aa7a9074f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:17.625007 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:17.689425 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1484/2933] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:17.706939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:17.708680 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:17.723839 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:17.788712 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10d55-3ca2-4bd7-b362-7b6086145015 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:17.794729 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:17.795394 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:17.795677 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:17.795946 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:17.797682 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:17.871014 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:17.872630 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:17.882404 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1450/2934] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:18.903552 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] REQUEST_METHOD: `POST` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:18.904038 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:18.904158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:18.925196 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.auth.core [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] MFA Rules not processed for user `0977ec7de09f4205a9411d712f4550c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 16:24:18.926644 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:18.934370 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1485/2935] 10.222.0.30 () {58 vars in 958 bytes} [Tue Aug 30 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 16:24:27.877819 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=50 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:28.918210 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=27 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:41.411687 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:41.413104 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:41.498226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014b26-c7b3-43d6-890c-73c5c6482d69 service nova] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:41.502410 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:41.503026 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:41.503314 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:41.503584 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:41.531881 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:41.533305 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:41.543430 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1451/2936] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:42.136255 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:24:42.137659 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:42.256499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cecca-dba1-4256-9346-df4c97605c99 None None] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:24:42.261764 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:24:42.262371 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:24:42.262653 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:24:42.262946 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:24:42.264674 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:24:42.276647 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:24:42.278247 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:24:42.288613 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1486/2937] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:24:51.538428 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=48 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:52.284059 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=53 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:37.836775 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:26:37.838298 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:26:37.874817 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea54030-f5b9-474b-a943-3b6352dd217a service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:26:37.878391 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:26:37.879006 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:26:37.879291 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:26:37.879559 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:26:37.881400 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:26:37.913582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:26:37.915038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:26:37.936015 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1452/2938] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:26:39.113840 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:26:39.124049 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa04c6-aae0-418b-a043-e957d96fc0dc service placement] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:26:39.127615 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:26:39.128204 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:26:39.128488 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:26:39.128765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:26:39.130518 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:26:39.144292 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:26:39.145712 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:26:39.156566 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1487/2939] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:26:47.933529 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=27 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:49.151835 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=6 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:41.899696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:27:41.909081 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4a2b4-3a0f-45b3-8782-206c1ff2c47a service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:27:41.912913 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '183c8b4ac78f42678d68527a0c6e09ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:27:41.913551 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:27:41.913857 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:27:41.914145 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:27:41.915880 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:27:41.925226 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:27:41.926648 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:27:41.935008 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1453/2940] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:27:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:27:51.931709 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=6 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:09.134573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:28:09.150499 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6758c-8dd7-4221-82fd-ab795e92520c service neutron] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:28:09.158082 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2fa4b0a3974d0e9b04726511427631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:28:09.158690 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] REQUEST_METHOD: `GET` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:28:09.158968 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:28:09.159573 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:28:09.162268 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:28:09.177747 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:28:09.179437 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:28:09.190716 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1488/2941] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:28:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 16:28:19.190623 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=6 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:19.192583 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:28:19.195582 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:28:19.297242 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0e79-d6f3-4f98-a819-fae8a5074a23 service neutron] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:28:19.301837 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:28:19.302463 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:28:19.302748 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:28:19.303124 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] PATH_INFO: `/v3/users/0977ec7de09f4205a9411d712f4550c8` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:28:19.304264 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0977ec7de09f4205a9411d712f4550c8)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:28:19.306207 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:28:19.352438 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0977ec7de09f4205a9411d712f4550c8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.365038 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0977ec7de09f4205a9411d712f4550c8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.372371 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0977ec7de09f4205a9411d712f4550c8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.380613 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0977ec7de09f4205a9411d712f4550c8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.381468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0977ec7de09f4205a9411d712f4550c8'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.388086 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1454/2942] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:28:19 2022] DELETE /identity/v3/users/0977ec7de09f4205a9411d712f4550c8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:28:19.560617 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:28:19.574565 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f3ac-d842-4429-849b-785865c316bd service nova] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:28:19.632592 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:28:19.633222 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:28:19.633505 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:28:19.633785 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] PATH_INFO: `/v3/projects/7ea06918c1784d9284f0b999dff94ec5` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:28:19.634902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea06918c1784d9284f0b999dff94ec5)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:28:19.636851 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:28:19.683765 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea06918c1784d9284f0b999dff94ec5', 'request_id': 'req-2c009fde-b353-4854-b6ba-0269246da715'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.691632 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea06918c1784d9284f0b999dff94ec5', 'request_id': 'req-2c009fde-b353-4854-b6ba-0269246da715'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.697698 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea06918c1784d9284f0b999dff94ec5', 'request_id': 'req-2c009fde-b353-4854-b6ba-0269246da715'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.707800 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] The token cache is being invalidate because project 7ea06918c1784d9284f0b999dff94ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:28:19.708086 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.708711 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.710158 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1489/2943] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:28:19 2022] DELETE /identity/v3/projects/7ea06918c1784d9284f0b999dff94ec5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:28:19.714235 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:28:19.715665 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:28:19.728871 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1f84-eea2-4257-be2b-2820a28806e3 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:28:19.775658 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:19.787375 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:28:19.788004 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:28:19.788288 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:28:19.788563 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] PATH_INFO: `/v3/users/58b630e378c146b78efd172a4a6a65cf` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:28:19.789696 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b630e378c146b78efd172a4a6a65cf)` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:28:19.791660 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:28:19.837883 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b630e378c146b78efd172a4a6a65cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.852278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b630e378c146b78efd172a4a6a65cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.859985 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b630e378c146b78efd172a4a6a65cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.866939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b630e378c146b78efd172a4a6a65cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.867578 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.notifications [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b630e378c146b78efd172a4a6a65cf'} {{(pid=81609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:19.873740 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1455/2944] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 16:28:19 2022] DELETE /identity/v3/users/58b630e378c146b78efd172a4a6a65cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 16:28:20.048175 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Authenticating user token {{(pid=81608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:28:20.049692 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.fernet_utils [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:28:20.063831 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009fde-b353-4854-b6ba-0269246da715 admin admin] Validating token access rules against request {{(pid=81608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:28:20.121637 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c8d533e615444eb88b70808ed8254b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182090e6549d4fc0b6e88a4c20692c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:28:20.122191 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:28:20.122473 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:28:20.122749 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] PATH_INFO: `/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4` {{(pid=81608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:28:20.123902 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5b1717286043d6bca5eb9a98ac3da4)` {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:28:20.126313 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] RBAC: Authorization granted {{(pid=81608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:28:20.160119 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:20.174253 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5b1717286043d6bca5eb9a98ac3da4', 'request_id': 'req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:20.182053 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5b1717286043d6bca5eb9a98ac3da4', 'request_id': 'req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:20.188771 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5b1717286043d6bca5eb9a98ac3da4', 'request_id': 'req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb'} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:20.198961 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] The token cache is being invalidate because project 3e5b1717286043d6bca5eb9a98ac3da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 16:28:20.199538 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:20.199900 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG keystone.notifications [None req-46e63142-e5fa-49e5-a5a4-5c67ca967ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 16:28:20.201360 dv-cinder-852208-13-smb devstack@keystone.service[81608]: [pid: 81608|app: 0|req: 1490/2945] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 16:28:20 2022] DELETE /identity/v3/projects/3e5b1717286043d6bca5eb9a98ac3da4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 16:28:29.870178 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:30.196001 dv-cinder-852208-13-smb devstack@keystone.service[81608]: DEBUG dbcounter [-] [81608] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:46.155468 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Authenticating user token {{(pid=81609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 16:29:46.156939 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:29:46.226386 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4922-8c20-4ec2-9caf-2c4f8d929ef1 admin admin] Validating token access rules against request {{(pid=81609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 16:29:46.284132 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d3e6537d3347e08b1e8460b5a5c152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e0060ba2a884a119c02bba06d8c4634', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 16:29:46.284732 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] REQUEST_METHOD: `GET` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 16:29:46.285009 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] SCRIPT_NAME: `/identity` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 16:29:46.285278 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 16:29:46.287567 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.fernet_utils [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 16:29:46.298539 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 16:29:46.300140 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0662b-4e7e-40fc-bcda-668a9912e354 service placement] RBAC: Authorization granted {{(pid=81609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 16:29:46.310495 dv-cinder-852208-13-smb devstack@keystone.service[81609]: [pid: 81609|app: 0|req: 1456/2946] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Aug 30 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 16:29:56.306345 dv-cinder-852208-13-smb devstack@keystone.service[81609]: DEBUG dbcounter [-] [81609] Writing DB stats keystone:SELECT=58 {{(pid=81609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}